-- Logs begin at Fri 2022-09-09 20:46:14 UTC, end at Fri 2022-09-09 21:48:57 UTC. -- Sep 09 21:16:42.237900 dv-cinder-852210-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 21:16:42.246327 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 21:16:42.249723 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 21:16:42 2022] *** Sep 09 21:16:42.249723 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 21:16:42.249723 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 21:16:42.249723 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: nodename: dv-cinder-852210-15-iscsi Sep 09 21:16:42.249723 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: machine: x86_64 Sep 09 21:16:42.249723 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: clock source: unix Sep 09 21:16:42.249723 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: pcre jit disabled Sep 09 21:16:42.249723 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: detected number of CPU cores: 4 Sep 09 21:16:42.249723 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: current working directory: / Sep 09 21:16:42.249723 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: detected binary path: /usr/bin/uwsgi-core Sep 09 21:16:42.250328 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: your processes number limit is 47680 Sep 09 21:16:42.250328 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: your memory page size is 4096 bytes Sep 09 21:16:42.250328 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: detected max file descriptor number: 2048 Sep 09 21:16:42.250328 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: lock engine: pthread robust mutexes Sep 09 21:16:42.250328 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: thunder lock: enabled Sep 09 21:16:42.250328 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 21:16:42.250328 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 21:16:42.290540 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: Python main interpreter initialized at 0x557d6cbf09c0 Sep 09 21:16:42.290540 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: python threads support enabled Sep 09 21:16:42.290540 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: your server socket listen backlog is limited to 100 connections Sep 09 21:16:42.290540 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: your mercy for graceful operations on workers is 90 seconds Sep 09 21:16:42.290867 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 21:16:42.290957 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: *** Operational MODE: preforking *** Sep 09 21:16:42.291205 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: *** uWSGI is running in multiple interpreter mode *** Sep 09 21:16:42.291205 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: spawned uWSGI master process (pid: 105449) Sep 09 21:16:42.291395 dv-cinder-852210-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 21:16:42.291979 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: spawned uWSGI worker 1 (pid: 105450, cores: 1) Sep 09 21:16:42.292315 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: spawned uWSGI worker 2 (pid: 105451, cores: 1) Sep 09 21:16:42.299560 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 21:16:42.952440 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 21:16:42.961408 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 21:16:44.029455 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:16:44.029455 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: from cryptography.utils import int_from_bytes Sep 09 21:16:44.030057 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:16:44.030057 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: from cryptography.utils import int_from_bytes Sep 09 21:16:44.033122 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:16:44.033122 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: from cryptography.utils import int_from_bytes Sep 09 21:16:44.033593 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:16:44.033593 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: from cryptography.utils import int_from_bytes Sep 09 21:16:46.554055 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 21:16:46.554625 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 21:16:46.554829 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 21:16:46.555180 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 21:16:46.555430 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 21:16:46.555839 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.556166 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.556350 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 21:16:46.556717 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.556818 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 21:16:46.556902 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.557096 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.557184 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 21:16:46.557400 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.557501 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 21:16:46.557713 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.557807 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 21:16:46.558028 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.558137 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.558349 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.558447 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.558606 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.558702 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.558915 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.559026 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.559234 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-15-iscsi {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.560025 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.560217 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.560359 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.560528 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.560686 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.560830 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.561007 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.561143 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.561337 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.561425 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.561601 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.561746 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.561913 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.562046 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.562236 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-15-iscsi {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.562540 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.562955 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.562955 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.563195 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.563310 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.563420 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.563565 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.563694 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.563803 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.563909 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.564069 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.564199 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.564371 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.564506 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.564819 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.564963 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.565129 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.565228 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.565449 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.565537 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.565753 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.565849 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.566083 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.566176 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-15-iscsi {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.566403 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.566502 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.566700 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.566797 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.567015 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.567110 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.567319 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.567415 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.567661 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.567768 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.567971 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.568077 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.568343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.568445 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-15-iscsi {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.568663 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.568760 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.568968 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.569068 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.569277 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.569376 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.569591 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.569679 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.569905 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.570001 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.570218 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.570307 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.570517 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.570613 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.570821 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.570912 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.571125 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.571214 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.571438 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.571556 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.571766 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.571863 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.572068 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.572156 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.572315 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.572429 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.572619 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.572708 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.572935 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.573031 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.573249 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.573357 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.573565 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.573656 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.573813 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.573903 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.574059 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.574158 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.574372 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.574460 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.574684 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.574771 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.575561 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.575692 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.575896 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.576107 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.576196 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.576450 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.576601 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.576695 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.576837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.577000 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.577152 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.577316 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.577466 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.577620 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.577762 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.577913 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.578062 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.578218 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.578395 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.578506 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.578666 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.578789 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.578985 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.579088 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.579293 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.579392 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.579643 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.579786 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.580008 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.580176 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.580313 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.580409 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.580567 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.580663 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.580902 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.580999 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.581217 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.581315 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.581524 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.581619 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.581839 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.581932 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.582149 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.582295 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.582435 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.582573 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.582734 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.582889 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.583023 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.583196 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.583340 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.583501 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.583674 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.583762 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.583942 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.584179 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.584478 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.584693 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.584783 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.585084 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.585175 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.585386 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.585687 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.585783 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.585988 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.586265 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.586354 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.586566 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.586865 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.587004 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.587164 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.587425 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.587522 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.587777 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.587925 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.588077 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.588376 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.588508 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.588677 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.588976 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.589078 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.589274 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.589587 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.589674 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.589901 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.590198 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.590300 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.590499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.590802 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.590908 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.591222 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.591378 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.591617 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.591925 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.592012 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.592230 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.592539 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.592628 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.592841 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.593111 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.593207 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.593441 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.593691 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.593786 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.594033 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.594277 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.594373 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.594630 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.594840 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.594935 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.595239 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.595327 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.595551 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.595712 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.595932 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.596213 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.596304 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.596520 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.596627 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.596820 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.596913 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.597120 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.597217 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.597416 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.597504 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.597714 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.597810 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.598009 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.598099 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.598321 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.598418 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.598637 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.598734 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.598941 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.599030 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.599243 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.599330 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.599551 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.599686 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.599879 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.599977 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.600193 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.600280 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.600500 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.600589 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.600821 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.600911 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.601130 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.601217 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.601436 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.601533 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.601757 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.601845 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.602059 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.602145 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.602365 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.602461 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.602676 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.602765 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.602981 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.603076 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.603288 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.603392 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.603615 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.603719 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.603921 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.604015 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.604227 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.604316 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.604531 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.604628 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.604833 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.604921 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.605136 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.605224 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.605435 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.605523 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.605749 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.605847 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.606055 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.606142 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.606409 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.606689 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.606774 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.607005 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.607101 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.607315 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.607403 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.607664 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:16:46.607755 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.608004 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.608106 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.608314 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.608412 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.608634 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.608769 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.608952 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.609059 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.609259 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.609349 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.609566 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.609705 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.609872 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.609975 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.610199 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.610287 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.610508 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.610595 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.610815 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.610904 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.611129 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.611217 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.611435 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.611524 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.611769 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.611858 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.612075 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.612170 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.612380 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.612468 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.612688 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.612782 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.612993 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.613082 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.613299 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.613387 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.613619 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.613716 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.613927 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.614014 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.614242 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.614338 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.614549 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.614638 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.614858 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.614948 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.615171 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.615273 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.615477 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.615587 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.615809 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.615899 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.616116 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.616221 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.616416 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.616506 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.616715 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.616810 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.617014 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.617120 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.617316 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.617412 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.617614 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.617703 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.617930 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.618020 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.618251 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.618339 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.618551 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.618640 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.618876 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.618965 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.619175 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.619263 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.619477 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.619627 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.619809 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.619899 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.620115 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.620204 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.620413 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.620501 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.620719 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.620816 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.621026 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.621113 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.621323 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.621424 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.621637 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.621727 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.622487 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.622579 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.622805 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.622954 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.623221 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.623311 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.623423 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.623598 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.623763 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.623952 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.624079 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.624209 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.624400 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.624520 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.624708 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.624836 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.625005 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.625147 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.625313 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.625463 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.625626 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.625783 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.625929 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.626095 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.626255 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.626402 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.627631 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.627728 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.627799 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.627867 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.627941 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.628009 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.628085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.628154 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.628221 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.628294 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.628785 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.628891 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.628989 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.629072 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.629140 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.629207 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.629273 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.629348 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.629423 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.629545 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.629712 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.629861 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.629999 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.630153 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.630302 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.630440 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.630600 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.630737 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.630894 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.631032 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.631109 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.631327 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.631436 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.631583 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.631684 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.631899 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.632000 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.632202 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.632309 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.632502 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.632598 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.635001 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.635162 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.635279 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.635395 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.635514 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.635680 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.635794 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.635902 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.636008 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.636115 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.636221 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.636342 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.636452 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.636558 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.636665 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.636773 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.638164 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.638285 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.638446 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.638604 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.638692 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.638761 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.638839 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.638916 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.638991 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639059 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639177 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639277 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639361 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639451 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639562 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639660 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639732 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639812 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639812 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.639943 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640022 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640102 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640181 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640269 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640350 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640419 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640493 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640582 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640663 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640757 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640838 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.640925 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.641007 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.641094 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.641183 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.641271 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.641359 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.641440 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.641519 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.641735 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.641905 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.642056 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.642205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.642352 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.642499 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.642648 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.643062 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.643213 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.643360 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.643491 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.643608 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.643783 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.643879 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.644088 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.644178 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.644400 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.644487 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.644770 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.644885 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.645015 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.645113 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.645324 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.645413 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.645637 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.645717 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.645942 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.646102 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.646268 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.646421 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.646584 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.646732 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.646870 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.647009 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.647168 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.647319 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.647480 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.647708 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.647862 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.648008 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.648162 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.648295 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.648389 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.648460 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.648646 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.648727 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.648944 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.649032 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.649243 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.649322 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.649549 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.649629 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.649882 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.649986 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.650176 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.650265 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.650482 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.650570 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.650783 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.650884 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.651088 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.651176 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.651389 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.651477 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.651716 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.651826 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.652015 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.652106 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.652321 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.652409 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.652636 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.652726 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.652937 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.653056 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.653334 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.653430 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.653660 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.653787 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.653988 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.654107 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.654299 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.654409 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.654613 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.654726 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.654976 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.655072 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.655225 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.655314 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.655586 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.655682 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.655860 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.655949 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.656162 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.656262 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.656465 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.656555 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.656779 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.656868 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.657089 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.657191 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.657397 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.657494 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.657705 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.657794 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.658006 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.658105 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.658308 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.658396 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.658612 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.658701 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.658912 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.659009 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.659215 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.659303 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.659515 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.659672 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.659845 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.659951 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.660152 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.660253 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.660453 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.660550 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.660758 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.660856 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.661065 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.661157 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.661365 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.661455 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.661670 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.661768 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.661976 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.662071 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.662272 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.662359 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.662573 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.662669 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.662875 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.662964 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.663215 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.663451 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.663594 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.663807 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.663897 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.664120 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.664209 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.664435 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.664535 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.664741 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.664828 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.665057 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.665169 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.665364 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.665463 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.665671 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.665769 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.665988 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.666077 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.666287 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.666388 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.666591 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.666680 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.666891 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.666981 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.667191 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.667291 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.667495 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.667603 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.667816 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.667904 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.668132 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.668243 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.668415 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.668505 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.668760 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.668919 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.669117 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.669240 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.669496 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.669589 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.669706 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.669846 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.670005 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.670170 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.670319 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.670615 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.670734 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.670921 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.671065 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.671218 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.671381 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.671551 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.671726 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.671863 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.672073 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.672174 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.672392 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.672491 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.672720 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.672823 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.673048 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.673146 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.673345 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.673434 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.673654 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.673741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.673965 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.674055 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.674269 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.674365 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.674573 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.674662 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.674872 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.674961 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.675172 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.675261 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.675476 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.675592 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.675799 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.675888 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.676098 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.676187 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.676399 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.676495 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.676698 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.676789 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.676995 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.677084 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.677296 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.677393 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.677597 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.677685 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.677896 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.677991 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.678194 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.678291 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.678489 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.678579 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.678791 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.678892 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.679089 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.679187 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.679388 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.679476 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.679711 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.679804 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.680011 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.680159 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.680312 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.680422 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.680618 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.680715 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.680923 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.681024 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.681218 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.681317 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.681520 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.681609 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.681816 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.681920 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.682123 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.682212 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.682418 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.682516 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.682714 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.682804 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.683011 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.683101 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.683313 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.683401 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.683637 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.683745 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.683935 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.684025 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.684232 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.684845 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.685089 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.685223 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.685362 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.685439 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.685665 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.685769 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.685968 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.686056 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.686264 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.686361 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.686561 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.686659 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.686860 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.686947 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.687173 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.687270 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.687478 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.687597 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.687803 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.687892 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.688104 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.688201 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.688400 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.688488 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.688699 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.688795 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.688995 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.689090 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.689294 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.689390 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.689588 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.689677 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.689886 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.689974 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.690181 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.690279 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.690476 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.690566 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.690771 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.690860 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.691074 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.691163 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.691374 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.691461 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.691694 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.691798 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.691996 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.692089 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.692291 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.692383 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.692590 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.692686 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.692888 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.692977 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.693192 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.693281 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.693493 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.693591 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.693794 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.693884 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.694098 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.694195 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.694416 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.694519 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.694718 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.694806 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.695014 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.695103 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.695309 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.695449 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.695629 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.695720 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.695934 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.696022 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.696232 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.696323 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.696528 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.696617 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.696825 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.696912 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.697130 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.697220 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.697429 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.697517 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.697726 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.697815 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.698027 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.698117 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.698338 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.698427 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.698642 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.698730 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.698936 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.699024 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.699233 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.699321 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.699546 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.699650 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.699854 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.700510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.700713 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.700848 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.700989 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.701096 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.701338 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.701465 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.701650 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.701752 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.701967 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.702066 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.702276 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.702365 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.702577 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.702666 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.702880 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.702980 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.703180 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.703279 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.703481 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.703589 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.703812 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.703903 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.704120 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.704218 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.704419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.704509 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.704714 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.704811 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.705021 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.705111 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.705321 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.705421 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.705627 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.705717 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.705922 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.706011 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.706247 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.706335 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.706567 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.706665 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.706869 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.706965 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.707180 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.707277 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.707486 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.707609 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.707815 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.707905 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.708124 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.708225 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.708430 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.708519 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.708724 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.708818 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.709037 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.709139 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.709346 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.709435 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.709654 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.709742 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.709962 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.710063 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.710266 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.710355 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.710573 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.710661 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.710875 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.710964 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.711175 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.711262 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.711477 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.711638 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.711801 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.711900 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.712099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.712188 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.712404 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.712499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.712701 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.712790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.713006 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.713094 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.713309 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.713398 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.713706 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.713802 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.714005 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.714095 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.714332 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.714435 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.714638 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.714735 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.714948 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.715036 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.715255 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.715353 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.715661 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.715772 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.715979 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.716123 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.716279 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.716413 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.716588 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.716803 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.716892 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.717123 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.717221 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.717435 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.717533 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.717749 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.717838 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.718053 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.718156 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.718355 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.718444 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.718665 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.718799 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.718977 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.719075 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.719279 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.719380 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.719608 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.719700 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.719914 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.720014 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.720234 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.720333 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.720538 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.720628 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.720858 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.720984 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.721213 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.721311 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.721517 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.721620 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.721818 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.722126 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.722258 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.722424 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.722569 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.722722 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.722878 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.723039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.723197 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.723338 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.723514 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.723652 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.723928 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.724031 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.724235 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.724324 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.724535 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.724625 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.724833 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.724933 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.725149 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.725238 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.725446 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.725535 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.725764 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.725861 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.726067 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.726155 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.726366 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.726455 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.726681 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.726777 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.726980 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.727083 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.727294 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.727383 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.727619 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.727712 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.727918 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.728038 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.728217 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.728358 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.728517 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.728668 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.728852 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.728990 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.729153 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.729315 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.729467 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.729619 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.729790 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.729923 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.730112 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.730231 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.730416 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.730534 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.730743 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.730835 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.731066 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.731297 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.731439 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.731646 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.731750 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.732032 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.732121 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.732351 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.732449 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.732651 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.732748 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.732951 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.733041 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.733253 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.733350 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.733549 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.733638 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.733851 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.733949 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.734149 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.734238 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.734451 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.734539 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.734748 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.734846 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.735046 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.735135 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.735345 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.735442 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.735696 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.735802 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.735995 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.736082 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.736295 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.736390 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.736600 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.736699 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.736895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.736984 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.737194 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.737282 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.737494 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.737585 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.737826 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.737913 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.738122 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.738209 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.738445 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.738535 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.738749 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.738845 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.739064 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.739159 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.739377 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.739467 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.739712 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.739802 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.740022 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.740112 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.740329 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.740427 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.740640 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.740729 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.740943 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.741079 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.741247 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.741340 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.741547 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.741635 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.741850 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.741991 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.742155 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.742252 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.742457 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.742554 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.742766 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.742966 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.743057 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.743287 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.743376 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.743621 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.743706 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.743931 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.744030 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.744237 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.744335 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.744547 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.744680 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.744855 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.744953 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.745159 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.745248 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.745461 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.745559 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.745764 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.745854 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.746064 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.746161 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.746386 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.746485 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.746699 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.747312 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.747593 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.747686 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.747889 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.747989 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.748207 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.748296 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.748513 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.748608 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.748822 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.748912 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.749130 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.749220 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.749441 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.749529 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.749756 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.749848 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.750063 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.750159 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.750368 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.750465 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.750684 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.750773 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.750990 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.751079 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.751298 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.751401 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.751626 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.751839 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.751931 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.752169 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.752261 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.752489 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.752581 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.752801 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.752890 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.753106 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.753202 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.753414 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.753504 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.753723 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.753810 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.754034 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.754132 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.754345 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.754436 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.754651 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.754738 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.754956 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.755044 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.755264 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.755355 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.755616 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.755805 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.755942 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.756120 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.756275 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.756446 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.756591 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.756764 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.756904 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.757082 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.757217 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.757394 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.757530 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.757705 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.757882 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.758024 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.758197 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.758324 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.758501 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.758625 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.758814 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.758930 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.759125 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.759235 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.759434 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.759633 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.759769 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.759859 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.760079 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.760168 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.760390 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.760489 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.760702 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.760792 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.761008 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.761097 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.761314 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.761530 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.761622 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.761871 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.761960 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.762179 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.762277 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.763046 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.763149 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.763369 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.763459 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.763708 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.763820 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.764012 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.764102 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.764330 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.764419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.764630 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.764848 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.764939 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.765163 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.765254 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.765493 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.765591 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.765801 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.765899 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.766106 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.766252 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.766410 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.766509 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.766713 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.766802 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.767011 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.767100 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.767314 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.767413 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.767635 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.767985 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.768195 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.768304 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.768504 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.768609 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.768801 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.768890 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.769100 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.769197 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.769407 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.769498 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.769706 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.769794 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.770002 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.770098 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.770303 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.770394 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.770602 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.770829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.770922 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.771183 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.771282 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.771483 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.771593 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.771804 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.771893 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.772111 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.772259 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.772460 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.772549 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.772766 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.772853 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.773062 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.773152 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.773379 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.773468 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.773678 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.773775 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.773976 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.774066 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.774288 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.774376 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.774592 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.774680 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.774893 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.774982 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.775199 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.775287 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.775505 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.775626 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.775838 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.775928 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.776148 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.776247 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.776452 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.776679 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.776770 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.777019 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.777108 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.777340 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.777430 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.777646 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.777742 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.777958 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.778096 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.778292 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.778396 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.778595 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.778694 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.778901 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.779046 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.779223 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.779352 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.779559 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.779691 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.779864 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.779997 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.780172 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.780307 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.780478 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.780611 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.780784 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.780922 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.781091 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.781276 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.781397 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.781586 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.781704 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.781890 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.782010 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.782211 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.782345 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.782522 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.782613 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.782823 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.782922 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.783136 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.783226 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.783445 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.783591 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.783789 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.783893 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.784101 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.784232 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.784413 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.784514 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.784722 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.784820 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.785034 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.785124 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.785346 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.785568 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.785667 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.785898 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.785993 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.786220 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.786310 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.786523 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.786628 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.786833 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.786923 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.787158 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.787250 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.787460 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.787576 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.787790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.787880 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.788111 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.788421 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.788518 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.788733 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.788825 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.789041 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.789130 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.789348 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.789516 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.789655 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.789745 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.789964 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.790062 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.790270 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.790374 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.790576 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.790667 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.790881 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.790972 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.791187 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.791286 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.791493 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.791626 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.791824 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.791917 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.792132 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.792224 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.792443 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.792533 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.792755 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.792843 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.793057 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.793149 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.793357 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.793447 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.793686 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.793788 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.794014 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.794126 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.794445 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.794532 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.794754 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.794852 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.795064 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.795161 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.795372 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.795461 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.795697 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.795800 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.796006 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.796095 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.796306 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.796395 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.796603 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.796704 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.796905 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.797002 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.797202 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.797500 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.797587 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.797798 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.797895 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.798095 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.798184 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.798391 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.798490 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.798687 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.798798 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.798988 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.799122 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.799284 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.799428 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.799605 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.799776 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.799902 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.800099 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.800198 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.800411 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.800503 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.800740 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.800829 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.801075 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.801174 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.801400 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.801489 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.801717 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.801844 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.802020 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.802117 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.802326 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.802417 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.802631 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.802730 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.802937 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.803035 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.803249 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.803337 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.803574 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.803665 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.803881 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.803982 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.804228 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.804324 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.804490 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.804581 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.804793 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.804883 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.805095 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.805185 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.805394 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.805490 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.805693 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.805782 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.805999 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.806088 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.806297 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.806385 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.806601 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.806692 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.806901 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.806990 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.807200 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.807289 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.807501 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.807631 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.807822 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.807923 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.808129 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.808232 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.808430 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.808519 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.808732 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.808822 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.809032 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.809134 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.809869 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.810004 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.810281 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.810426 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.810592 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.810697 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.810900 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.810998 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.811211 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.811310 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.811518 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.811681 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.811850 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.811987 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.812163 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.812253 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.812474 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.812575 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.812793 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.812882 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.813110 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.813197 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.813417 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.813508 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.813725 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.813813 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.814043 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.814131 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.814352 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.814441 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.814671 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.814761 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.814985 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.815084 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.815293 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.815383 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.815625 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.815720 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.815934 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.816035 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.816240 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.816330 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.816478 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 21:16:46.816568 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.816855 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.817178 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.817494 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.817811 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.818124 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.818434 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.818758 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.819065 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.819376 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.819705 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.820016 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.820325 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.820638 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.820945 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.821252 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.821568 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.821880 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.822202 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.822526 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.822834 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.823162 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.823484 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.823853 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.824169 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.824509 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.824834 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.825702 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.826009 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.826312 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:16:46.826555 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 21:16:46.969085 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Registered counter for database nova_api Sep 09 21:16:46.978227 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Registered counter for database nova_api Sep 09 21:16:46.991047 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:16:46.998124 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:16:46.999160 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-c5310b55-4947-4749-9a92-884211c0450f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:16:47.005522 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:16:47.054948 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.context [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b917e871-a448-4561-a39a-585fcf48a3c9(cell1) {{(pid=105451) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 21:16:47.058910 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:47.059988 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:47.061521 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:47.062229 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:47.062668 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:47.062919 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.context [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b917e871-a448-4561-a39a-585fcf48a3c9(cell1) {{(pid=105450) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 21:16:47.064655 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:47.066627 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Registered counter for database nova_cell0 Sep 09 21:16:47.067024 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:47.067498 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:47.069079 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:47.069791 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:47.070233 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:47.070623 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Registered counter for database nova_cell1 Sep 09 21:16:47.072228 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:47.074189 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Registered counter for database nova_cell0 Sep 09 21:16:47.077857 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:16:47.078371 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Registered counter for database nova_cell1 Sep 09 21:16:47.080318 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:16:47.084585 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:16:47.085483 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-c5310b55-4947-4749-9a92-884211c0450f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:16:47.087636 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-c5310b55-4947-4749-9a92-884211c0450f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:16:47.092391 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:16:47.095649 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:16:47.223957 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:16:47.233216 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Registered counter for database nova_cell0 Sep 09 21:16:47.240227 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:16:47.241304 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Registered counter for database nova_cell0 Sep 09 21:16:47.245112 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:16:47.247945 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-c5310b55-4947-4749-9a92-884211c0450f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:16:47.252819 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:16:47.585744 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-c5310b55-4947-4749-9a92-884211c0450f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:16:47.586413 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:16:47.593673 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:16:47.594091 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:16:47.937124 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-c5310b55-4947-4749-9a92-884211c0450f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:16:47.937338 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:16:47.943112 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:16:47.945413 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:16:47.948373 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557d6cbf09c0 pid: 105450 (default app) Sep 09 21:16:47.951294 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c5310b55-4947-4749-9a92-884211c0450f None None] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:47.951916 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557d6cbf09c0 pid: 105451 (default app) Sep 09 21:16:47.952514 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c5310b55-4947-4749-9a92-884211c0450f None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002619 Sep 09 21:16:47.952928 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Fri Sep 9 21:16:47 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:10.145512 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:10.147462 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002639 Sep 09 21:18:10.148575 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:10.159845 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:10.161080 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_cell0:SELECT=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:10.162154 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_cell1:SELECT=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:10.162967 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:11.025968 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-9db617bb-88df-4602-8f24-bcb1d662fe0b admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:11.059095 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-9db617bb-88df-4602-8f24-bcb1d662fe0b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904446 Sep 09 21:18:11.060029 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1292 bytes} [Fri Sep 9 21:18:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:13.721293 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:13.722677 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-f9444ced-f580-4d80-9602-1ebc55eb9878 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 09 21:18:13.722677 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 2/4] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:14.191596 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-9512e332-d023-4e8f-8a9a-d1c16ddb2fd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "id": "c1", "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:14.237486 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-9512e332-d023-4e8f-8a9a-d1c16ddb2fd2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.508219 Sep 09 21:18:14.238036 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 3/5] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 21:18:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 21:18:14.252553 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=3 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.253413 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell1:SELECT=3 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.255466 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell0:SELECT=3 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.256392 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:14.462993 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-18830dd7-ce8e-4b4f-a2b7-4c6943da6a81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:14.531645 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-18830dd7-ce8e-4b4f-a2b7-4c6943da6a81 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284342 Sep 09 21:18:14.532399 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 3/6] 10.222.0.46 () {64 vars in 1336 bytes} [Fri Sep 9 21:18:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:17.163931 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-9512e332-d023-4e8f-8a9a-d1c16ddb2fd2 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:17.164937 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-9512e332-d023-4e8f-8a9a-d1c16ddb2fd2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Sep 09 21:18:17.165332 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 4/7] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:18:17.831460 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-dab28120-9732-49d4-a684-3b306e9786de admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:17.873633 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-dab28120-9732-49d4-a684-3b306e9786de admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.702134 Sep 09 21:18:17.874391 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 4/8] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 21:18:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 21:18:17.886895 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-0c80c484-25ee-4305-bd8f-ba3dbc847d65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:17.926823 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-0c80c484-25ee-4305-bd8f-ba3dbc847d65 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043741 Sep 09 21:18:17.927434 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 5/9] 10.222.0.46 () {64 vars in 1336 bytes} [Fri Sep 9 21:18:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:20.533907 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-dab28120-9732-49d4-a684-3b306e9786de admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:20.534965 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-dab28120-9732-49d4-a684-3b306e9786de admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 09 21:18:20.535388 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:20.968788 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-b083e43a-2e47-4722-aa26-a5f82ff2ec13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:20.987289 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-b083e43a-2e47-4722-aa26-a5f82ff2ec13 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444913 Sep 09 21:18:20.987878 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 6/11] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 21:18:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:18:21.001355 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-0881c652-cfba-4de0-9ad2-086f081effc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:21.030318 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-0881c652-cfba-4de0-9ad2-086f081effc8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032301 Sep 09 21:18:21.030548 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 6/12] 10.222.0.46 () {64 vars in 1336 bytes} [Fri Sep 9 21:18:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:23.692701 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-b083e43a-2e47-4722-aa26-a5f82ff2ec13 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:23.694233 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-b083e43a-2e47-4722-aa26-a5f82ff2ec13 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 09 21:18:23.694660 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 7/13] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:24.107822 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-ef7d30e9-04c6-4320-a932-f0828b52800c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:24.127968 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-ef7d30e9-04c6-4320-a932-f0828b52800c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427095 Sep 09 21:18:24.128702 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 7/14] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 21:18:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:18:24.141277 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-90fc1be1-cea4-4b97-a197-a7b8729f4bb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:24.167504 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-90fc1be1-cea4-4b97-a197-a7b8729f4bb2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029997 Sep 09 21:18:24.168833 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 8/15] 10.222.0.46 () {64 vars in 1336 bytes} [Fri Sep 9 21:18:24 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:26.833359 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-ef7d30e9-04c6-4320-a932-f0828b52800c admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:26.835064 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-ef7d30e9-04c6-4320-a932-f0828b52800c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 09 21:18:26.835446 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 8/16] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:27.314477 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c03c86ef-3e41-4ade-aad3-6d2b7d65d2a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:27.338000 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c03c86ef-3e41-4ade-aad3-6d2b7d65d2a6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494348 Sep 09 21:18:27.338689 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 9/17] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 21:18:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:18:27.354208 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-472fe9af-458c-4cc0-95fc-b6ab50148281 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:27.384798 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-472fe9af-458c-4cc0-95fc-b6ab50148281 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035827 Sep 09 21:18:27.385580 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 9/18] 10.222.0.46 () {64 vars in 1336 bytes} [Fri Sep 9 21:18:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:30.679340 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c03c86ef-3e41-4ade-aad3-6d2b7d65d2a6 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:30.680400 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c03c86ef-3e41-4ade-aad3-6d2b7d65d2a6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 09 21:18:30.680807 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 10/19] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:18:31.126047 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-2dd10ae3-f1ca-47b8-9457-e06adfa00a78 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:31.150471 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-2dd10ae3-f1ca-47b8-9457-e06adfa00a78 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.463619 Sep 09 21:18:31.150999 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1292 bytes} [Fri Sep 9 21:18:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:18:33.795956 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c03c86ef-3e41-4ade-aad3-6d2b7d65d2a6 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:33.796970 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c03c86ef-3e41-4ade-aad3-6d2b7d65d2a6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 09 21:18:33.797370 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 11/21] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:34.200055 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-b5b3b1d0-d9b7-4886-9165-c81c405ad506 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:34.222723 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-b5b3b1d0-d9b7-4886-9165-c81c405ad506 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.419061 Sep 09 21:18:34.223297 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 11/22] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 21:18:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:18:34.236358 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-1b2854da-96f2-47b1-8b20-50d121930a65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:34.264952 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-1b2854da-96f2-47b1-8b20-50d121930a65 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032539 Sep 09 21:18:34.265540 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 12/23] 10.222.0.46 () {64 vars in 1333 bytes} [Fri Sep 9 21:18:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:36.876217 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-b5b3b1d0-d9b7-4886-9165-c81c405ad506 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:36.877279 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-b5b3b1d0-d9b7-4886-9165-c81c405ad506 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Sep 09 21:18:36.877686 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:37.304242 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-45a52b8b-5154-42bd-8402-2e7d56672a4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:37.328665 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-45a52b8b-5154-42bd-8402-2e7d56672a4b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.443516 Sep 09 21:18:37.329382 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 13/25] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 21:18:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 21:18:37.342208 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-b7ea12fd-ea05-414d-b755-b9f9c635429a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:37.369902 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-b7ea12fd-ea05-414d-b755-b9f9c635429a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031423 Sep 09 21:18:37.370870 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 13/26] 10.222.0.46 () {64 vars in 1333 bytes} [Fri Sep 9 21:18:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:40.011225 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-45a52b8b-5154-42bd-8402-2e7d56672a4b admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:40.012204 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-45a52b8b-5154-42bd-8402-2e7d56672a4b admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 09 21:18:40.012616 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 14/27] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:40.470845 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-ae080334-dbca-4851-90f8-452d7a8a72c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 2, "id": "3", "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:40.490598 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-ae080334-dbca-4851-90f8-452d7a8a72c0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.471565 Sep 09 21:18:40.494232 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 14/28] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 21:18:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 21:18:40.505822 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-2e190dde-8173-4ce3-be15-084e2dee3c7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:40.515991 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:40.543660 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-2e190dde-8173-4ce3-be15-084e2dee3c7f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043267 Sep 09 21:18:40.544463 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 15/29] 10.222.0.46 () {64 vars in 1333 bytes} [Fri Sep 9 21:18:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:43.200861 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-ae080334-dbca-4851-90f8-452d7a8a72c0 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:43.201783 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-ae080334-dbca-4851-90f8-452d7a8a72c0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 09 21:18:43.202196 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 15/30] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:43.646537 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-2053de6e-eeeb-492a-a7cb-b1319b483936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "vcpus": 4, "ram": 8192}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:43.668351 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-2053de6e-eeeb-492a-a7cb-b1319b483936 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459983 Sep 09 21:18:43.669049 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 16/31] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 21:18:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 21:18:43.681088 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-facc1793-ffd4-4de0-8586-72ab36888866 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:43.706432 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-facc1793-ffd4-4de0-8586-72ab36888866 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029066 Sep 09 21:18:43.707051 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 16/32] 10.222.0.46 () {64 vars in 1333 bytes} [Fri Sep 9 21:18:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:46.472942 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-2053de6e-eeeb-492a-a7cb-b1319b483936 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:46.474582 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-2053de6e-eeeb-492a-a7cb-b1319b483936 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Sep 09 21:18:46.475141 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 17/33] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:18:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:46.914051 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-befdbaab-0b9d-4043-be20-c6baff8d2141 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:46.926034 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:46.941917 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-befdbaab-0b9d-4043-be20-c6baff8d2141 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.457562 Sep 09 21:18:46.942755 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 17/34] 10.222.0.46 () {64 vars in 1283 bytes} [Fri Sep 9 21:18:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:18:46.955197 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-cbd14213-29d5-448b-9c45-5ea80cfd19cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:46.987101 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-cbd14213-29d5-448b-9c45-5ea80cfd19cd admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035351 Sep 09 21:18:46.987960 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 18/35] 10.222.0.46 () {64 vars in 1333 bytes} [Fri Sep 9 21:18:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:02.973316 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-befdbaab-0b9d-4043-be20-c6baff8d2141 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:02.974324 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-befdbaab-0b9d-4043-be20-c6baff8d2141 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 09 21:19:02.974719 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 18/36] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:02.985283 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:03.362032 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-6a9b4fa6-f3ee-41f5-81e0-c0b5c6fd1e33 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:03.380661 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-6a9b4fa6-f3ee-41f5-81e0-c0b5c6fd1e33 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399866 Sep 09 21:19:03.381189 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 19/37] 10.222.0.46 () {60 vars in 1292 bytes} [Fri Sep 9 21:19:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:19:04.737760 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-befdbaab-0b9d-4043-be20-c6baff8d2141 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:04.738769 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-befdbaab-0b9d-4043-be20-c6baff8d2141 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 09 21:19:04.739172 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 19/38] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:05.271329 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-f11d2d46-d56a-4297-a456-9b11e701bef7 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:05.278294 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.wsgi [None req-f11d2d46-d56a-4297-a456-9b11e701bef7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-f11d2d46-d56a-4297-a456-9b11e701bef7 admin admin] Request method failure captured: Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Accept: application/json Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Accept-Encoding: gzip, deflate Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Connection: keep-alive Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Content-Length: 0 Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Host: 10.222.0.46 Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Openstack-Api-Version: compute 2.92 Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Openstack-System-Scope: None Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: User-Agent: python-novaclient Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Auth-Token: gAAAAABjG63IKKbhP_3K0RqSVnzdbzrzYwUcrX5zRdpsF_qSzzs3xDfPfvdQMlEspHLYQ4i2AL1hGAcTYzlUFtoN8bGUSIxwnpuS-lg1ANXO6n8-rQpaJG73gf7NDsiR5dPtbBUkEnfiTkRgfMXnGStts78olH4j8hmaIcawNCyHKnoxquEiGjA Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Domain-Id: None Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Domain-Name: None Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Identity-Status: Confirmed Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Is-Admin-Project: True Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Domain-Id: default Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Domain-Name: Default Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Name: admin Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Role: reader,member,admin Sep 09 21:19:05.281510 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Roles: reader,member,admin Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fc5a8e0f96e744888fe26890d52ecbca", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fc5a8e0f96e744888fe26890d52ecbca"}]}] Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Tenant: admin Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Tenant-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Tenant-Name: admin Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User: admin Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Domain-Id: default Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Domain-Name: Default Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Id: 18ebcbcfc62641d6bab3f3ca3d6448ae Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Name: admin Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: method: > Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: exception: Flavor 42 could not be found. Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: action_args: {'id': '42'} Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:19:05.282935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:05.283935 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:05.285419 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-f11d2d46-d56a-4297-a456-9b11e701bef7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:19:05.286779 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-f11d2d46-d56a-4297-a456-9b11e701bef7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.406401 Sep 09 21:19:05.286779 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Sep 9 21:19:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 21:19:05.293254 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-8d688cd3-d028-406a-8a46-0b16c07396d1 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:05.315523 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-8d688cd3-d028-406a-8a46-0b16c07396d1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026434 Sep 09 21:19:05.316091 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 20/40] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 21:19:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:19:05.326520 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-32afd28d-a079-4241-a6df-8187e11b4196 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:05.348212 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-32afd28d-a079-4241-a6df-8187e11b4196 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026166 Sep 09 21:19:05.348736 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 21:19:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:19:05.358704 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a8dc2853-4589-44f8-9779-52e80630d460 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:05.363934 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.wsgi [None req-a8dc2853-4589-44f8-9779-52e80630d460 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a8dc2853-4589-44f8-9779-52e80630d460 admin admin] Request method failure captured: Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Accept: application/json Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Accept-Encoding: gzip, deflate Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Connection: keep-alive Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Content-Length: 0 Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Host: 10.222.0.46 Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Openstack-Api-Version: compute 2.92 Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Openstack-System-Scope: None Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: User-Agent: python-novaclient Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Auth-Token: gAAAAABjG63IKKbhP_3K0RqSVnzdbzrzYwUcrX5zRdpsF_qSzzs3xDfPfvdQMlEspHLYQ4i2AL1hGAcTYzlUFtoN8bGUSIxwnpuS-lg1ANXO6n8-rQpaJG73gf7NDsiR5dPtbBUkEnfiTkRgfMXnGStts78olH4j8hmaIcawNCyHKnoxquEiGjA Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Domain-Id: None Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Domain-Name: None Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Identity-Status: Confirmed Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Is-Admin-Project: True Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Domain-Id: default Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Domain-Name: Default Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Name: admin Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Role: reader,member,admin Sep 09 21:19:05.367140 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Roles: reader,member,admin Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fc5a8e0f96e744888fe26890d52ecbca", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fc5a8e0f96e744888fe26890d52ecbca"}]}] Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Tenant: admin Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Tenant-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Tenant-Name: admin Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User: admin Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Domain-Id: default Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Domain-Name: Default Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Id: 18ebcbcfc62641d6bab3f3ca3d6448ae Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Name: admin Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: method: > Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: exception: Flavor 42 could not be found. Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: action_args: {'id': '42'} Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:19:05.368741 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:05.369897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:05.372039 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a8dc2853-4589-44f8-9779-52e80630d460 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:19:05.373290 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a8dc2853-4589-44f8-9779-52e80630d460 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014142 Sep 09 21:19:05.373290 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Sep 9 21:19:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 21:19:06.597452 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-32afd28d-a079-4241-a6df-8187e11b4196 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:06.598461 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-32afd28d-a079-4241-a6df-8187e11b4196 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 09 21:19:06.598891 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 22/43] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:07.123925 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-dbda43d3-505f-4ebf-8864-0c466d32a52d admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:07.129017 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.wsgi [None req-dbda43d3-505f-4ebf-8864-0c466d32a52d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-dbda43d3-505f-4ebf-8864-0c466d32a52d admin admin] Request method failure captured: Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Accept: application/json Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Accept-Encoding: gzip, deflate Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Connection: keep-alive Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Content-Length: 0 Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Host: 10.222.0.46 Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Openstack-Api-Version: compute 2.92 Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Openstack-System-Scope: None Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: User-Agent: python-novaclient Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Auth-Token: gAAAAABjG63KZqeWZhl2xVuz1DvE23qaD5-ek1VN6l9bZ_U9bqfrlr_3Yz9NxsPttnZUG3UTlWjh-G95wQdTTQoIk7HbCuQdnz4ObcgL2V-6AAulEe9KBTMizIfQ4HU8xCoz1JWVLMBoGq3HqcrPOU_LyuXShOmb1kvixsNlqL76szDfLeqJfwg Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Domain-Id: None Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Domain-Name: None Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Identity-Status: Confirmed Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Is-Admin-Project: True Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Domain-Id: default Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Domain-Name: Default Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Name: admin Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Role: reader,member,admin Sep 09 21:19:07.130499 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Roles: reader,member,admin Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fc5a8e0f96e744888fe26890d52ecbca", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fc5a8e0f96e744888fe26890d52ecbca"}]}] Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Tenant: admin Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Tenant-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Tenant-Name: admin Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User: admin Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Domain-Id: default Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Domain-Name: Default Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Id: 18ebcbcfc62641d6bab3f3ca3d6448ae Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Name: admin Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: method: > Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: exception: Flavor 84 could not be found. Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: action_args: {'id': '84'} Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:19:07.132080 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:07.132895 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:07.134336 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-dbda43d3-505f-4ebf-8864-0c466d32a52d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:19:07.135435 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-dbda43d3-505f-4ebf-8864-0c466d32a52d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389398 Sep 09 21:19:07.135435 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Sep 9 21:19:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 21:19:07.142632 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-07419054-0775-4e41-96b8-6ad024a06a37 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:07.158071 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-07419054-0775-4e41-96b8-6ad024a06a37 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019247 Sep 09 21:19:07.158602 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 23/45] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 21:19:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:19:07.168362 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-ab640006-7b53-49ac-8950-0cee0d499fcd admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:07.183749 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-ab640006-7b53-49ac-8950-0cee0d499fcd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019224 Sep 09 21:19:07.184274 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 21:19:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:19:07.193328 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-1fa7f932-cde2-479a-9ed6-9623489604f5 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:07.198944 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.wsgi [None req-1fa7f932-cde2-479a-9ed6-9623489604f5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-1fa7f932-cde2-479a-9ed6-9623489604f5 admin admin] Request method failure captured: Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Accept: application/json Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Accept-Encoding: gzip, deflate Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Connection: keep-alive Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Content-Length: 0 Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Host: 10.222.0.46 Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Openstack-Api-Version: compute 2.92 Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Openstack-System-Scope: None Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: User-Agent: python-novaclient Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Auth-Token: gAAAAABjG63KZqeWZhl2xVuz1DvE23qaD5-ek1VN6l9bZ_U9bqfrlr_3Yz9NxsPttnZUG3UTlWjh-G95wQdTTQoIk7HbCuQdnz4ObcgL2V-6AAulEe9KBTMizIfQ4HU8xCoz1JWVLMBoGq3HqcrPOU_LyuXShOmb1kvixsNlqL76szDfLeqJfwg Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Domain-Id: None Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Domain-Name: None Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Identity-Status: Confirmed Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Is-Admin-Project: True Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Domain-Id: default Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Domain-Name: Default Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Name: admin Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Role: reader,member,admin Sep 09 21:19:07.200482 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Roles: reader,member,admin Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fc5a8e0f96e744888fe26890d52ecbca", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fc5a8e0f96e744888fe26890d52ecbca"}]}] Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Tenant: admin Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Tenant-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Tenant-Name: admin Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User: admin Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Domain-Id: default Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Domain-Name: Default Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Id: 18ebcbcfc62641d6bab3f3ca3d6448ae Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Name: admin Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: method: > Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: exception: Flavor 84 could not be found. Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: action_args: {'id': '84'} Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:19:07.202085 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:07.203205 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:07.204610 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-1fa7f932-cde2-479a-9ed6-9623489604f5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:19:07.205912 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-1fa7f932-cde2-479a-9ed6-9623489604f5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011945 Sep 09 21:19:07.205912 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 24/47] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Sep 9 21:19:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 21:19:08.435403 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-ab640006-7b53-49ac-8950-0cee0d499fcd admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:08.436426 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-ab640006-7b53-49ac-8950-0cee0d499fcd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 09 21:19:08.436820 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 24/48] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:08.963342 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-328b7fb9-b978-45a3-9bf6-389c840b295f admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:08.969750 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.wsgi [None req-328b7fb9-b978-45a3-9bf6-389c840b295f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-328b7fb9-b978-45a3-9bf6-389c840b295f admin admin] Request method failure captured: Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Accept: application/json Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Accept-Encoding: gzip, deflate Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Connection: keep-alive Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Content-Length: 0 Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Host: 10.222.0.46 Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Openstack-Api-Version: compute 2.92 Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Openstack-System-Scope: None Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: User-Agent: python-novaclient Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Auth-Token: gAAAAABjG63M25mYaLcFhLxIK9y9Nee2mFB1yKTYXtam4q7RgKYuchvme6dg7muBh0LAENppm6fnWldsLlCrNsg7lc7ZbMPUHjLGBWMopqJi7KXafYvVM-hoYL-Q7xD-uH3neMhwqkBQ3iX7-BPEDXgdmSgw08KXgFsMBnQqeL0RguwHhB23ZrU Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Domain-Id: None Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Domain-Name: None Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Identity-Status: Confirmed Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Is-Admin-Project: True Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Domain-Id: default Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Domain-Name: Default Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Project-Name: admin Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Role: reader,member,admin Sep 09 21:19:08.971246 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Roles: reader,member,admin Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fc5a8e0f96e744888fe26890d52ecbca", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fc5a8e0f96e744888fe26890d52ecbca"}]}] Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Tenant: admin Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Tenant-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-Tenant-Name: admin Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User: admin Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Domain-Id: default Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Domain-Name: Default Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Id: 18ebcbcfc62641d6bab3f3ca3d6448ae Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: X-User-Name: admin Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: method: > Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: exception: Flavor 451 could not be found. Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: action_args: {'id': '451'} Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:19:08.972829 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:08.973752 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 21:19:08.974790 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-328b7fb9-b978-45a3-9bf6-389c840b295f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:19:08.975842 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-328b7fb9-b978-45a3-9bf6-389c840b295f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.401100 Sep 09 21:19:08.975842 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 25/49] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 21:19:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 21:19:08.983109 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-bae2f27e-99d5-449f-a85c-cde806968a02 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:08.997975 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-bae2f27e-99d5-449f-a85c-cde806968a02 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019193 Sep 09 21:19:08.998506 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 25/50] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 21:19:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:19:09.007831 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:09.022944 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018589 Sep 09 21:19:09.023472 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 26/51] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Sep 9 21:19:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:19:09.033370 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-210dbc62-1e1f-4233-826e-0a822c8df47d admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:09.038323 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.wsgi [None req-210dbc62-1e1f-4233-826e-0a822c8df47d admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-210dbc62-1e1f-4233-826e-0a822c8df47d admin admin] Request method failure captured: Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Accept: application/json Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Accept-Encoding: gzip, deflate Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Connection: keep-alive Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Content-Length: 0 Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Host: 10.222.0.46 Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Openstack-Api-Version: compute 2.92 Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Openstack-System-Scope: None Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: User-Agent: python-novaclient Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Auth-Token: gAAAAABjG63M25mYaLcFhLxIK9y9Nee2mFB1yKTYXtam4q7RgKYuchvme6dg7muBh0LAENppm6fnWldsLlCrNsg7lc7ZbMPUHjLGBWMopqJi7KXafYvVM-hoYL-Q7xD-uH3neMhwqkBQ3iX7-BPEDXgdmSgw08KXgFsMBnQqeL0RguwHhB23ZrU Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Domain-Id: None Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Domain-Name: None Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Identity-Status: Confirmed Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Is-Admin-Project: True Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Domain-Id: default Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Domain-Name: Default Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Project-Name: admin Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Role: reader,member,admin Sep 09 21:19:09.039837 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Roles: reader,member,admin Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fc5a8e0f96e744888fe26890d52ecbca", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fc5a8e0f96e744888fe26890d52ecbca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fc5a8e0f96e744888fe26890d52ecbca"}]}] Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Tenant: admin Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Tenant-Id: fc5a8e0f96e744888fe26890d52ecbca Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-Tenant-Name: admin Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User: admin Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Domain-Id: default Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Domain-Name: Default Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Id: 18ebcbcfc62641d6bab3f3ca3d6448ae Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: X-User-Name: admin Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: method: > Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: exception: Flavor 451 could not be found. Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: action_args: {'id': '451'} Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:19:09.041343 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:09.043099 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 21:19:09.044544 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-210dbc62-1e1f-4233-826e-0a822c8df47d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:19:09.045731 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-210dbc62-1e1f-4233-826e-0a822c8df47d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011319 Sep 09 21:19:09.045731 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 26/52] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 21:19:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 21:19:10.278472 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:10.279508 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 09 21:19:10.279932 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 27/53] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:10.803106 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-b949a433-a858-4bd0-92d8-669a22123102 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:10.822265 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-b949a433-a858-4bd0-92d8-669a22123102 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404660 Sep 09 21:19:10.822795 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 27/54] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Sep 9 21:19:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:19:12.061670 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:12.062734 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 09 21:19:12.063125 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:12.588806 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a9732454-a966-4822-afbd-ad641691dcec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:12.607675 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a9732454-a966-4822-afbd-ad641691dcec admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.404804 Sep 09 21:19:12.608222 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 28/56] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Sep 9 21:19:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 21:19:13.828087 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:13.829121 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Sep 09 21:19:13.829536 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 29/57] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:14.351324 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-c49178e8-c19c-4586-9890-6d51b78a4f1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:14.369982 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-c49178e8-c19c-4586-9890-6d51b78a4f1c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404187 Sep 09 21:19:14.370512 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 29/58] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Sep 9 21:19:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 21:19:15.609823 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:15.610822 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 09 21:19:15.611218 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 30/59] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:16.141445 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-7e6cf8c2-dc79-49ec-ad6e-4b03fbab80fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:16.160155 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-7e6cf8c2-dc79-49ec-ad6e-4b03fbab80fb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.413058 Sep 09 21:19:16.160702 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 30/60] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Sep 9 21:19:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:19:17.388587 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:17.389630 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 09 21:19:17.390034 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 31/61] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:17.910692 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-2a47fe88-31f7-4589-8bb9-baf39fe29608 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:17.931582 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-2a47fe88-31f7-4589-8bb9-baf39fe29608 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402900 Sep 09 21:19:17.932120 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 31/62] 10.222.0.46 () {60 vars in 1202 bytes} [Fri Sep 9 21:19:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:20:15.454625 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:15.455691 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-e2625b5a-85af-4d7b-82a5-6ae02b9ef8f5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 09 21:20:15.456093 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 931 bytes} [Fri Sep 9 21:20:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:20:15.467183 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:15.855820 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-bcfdce32-36be-4e1e-b4de-57b42344584f admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:15.877252 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-bcfdce32-36be-4e1e-b4de-57b42344584f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415124 Sep 09 21:20:15.877788 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 32/64] 10.222.0.46 () {60 vars in 1292 bytes} [Fri Sep 9 21:20:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:20:15.898824 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=14 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:15.902703 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-d57801f6-a88a-4a7b-8ffe-4b17147cb654 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:15.910104 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-d57801f6-a88a-4a7b-8ffe-4b17147cb654 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012932 Sep 09 21:20:15.910627 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 33/65] 10.222.0.46 () {60 vars in 1283 bytes} [Fri Sep 9 21:20:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:15.922590 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-050eb889-de8c-4d73-90b1-0391c960618f admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:15.929850 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-050eb889-de8c-4d73-90b1-0391c960618f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011405 Sep 09 21:20:15.930364 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1286 bytes} [Fri Sep 9 21:20:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:15.942056 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-cf90805e-d1be-4ce7-9959-e2383e1e0b2c admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:15.949117 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-cf90805e-d1be-4ce7-9959-e2383e1e0b2c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010515 Sep 09 21:20:15.949621 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 34/67] 10.222.0.46 () {60 vars in 1286 bytes} [Fri Sep 9 21:20:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:15.961189 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-b3bee511-3051-414f-9e82-0ada5cb6cf3a admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:15.969152 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-b3bee511-3051-414f-9e82-0ada5cb6cf3a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011378 Sep 09 21:20:15.969707 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 34/68] 10.222.0.46 () {60 vars in 1283 bytes} [Fri Sep 9 21:20:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:23:12.673839 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-cf90805e-d1be-4ce7-9959-e2383e1e0b2c admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:12.674905 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-cf90805e-d1be-4ce7-9959-e2383e1e0b2c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 09 21:23:12.675297 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 35/69] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:23:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:23:12.813009 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=6 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:12.968990 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a0858be2-1a68-4394-a227-c12a81d0e8ee admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:12.974093 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a0858be2-1a68-4394-a227-c12a81d0e8ee admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:12.974560 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a0858be2-1a68-4394-a227-c12a81d0e8ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:12.974982 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a0858be2-1a68-4394-a227-c12a81d0e8ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:12.975717 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a0858be2-1a68-4394-a227-c12a81d0e8ee admin admin] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:12.976158 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a0858be2-1a68-4394-a227-c12a81d0e8ee admin admin] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:12.976563 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a0858be2-1a68-4394-a227-c12a81d0e8ee admin admin] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:13.010782 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a0858be2-1a68-4394-a227-c12a81d0e8ee admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.199002 Sep 09 21:23:13.011387 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 35/70] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 21:23:12 2022] GET /compute/v2.1/os-services => generated 794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:23:14.084018 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-cf90805e-d1be-4ce7-9959-e2383e1e0b2c admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:14.085019 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-cf90805e-d1be-4ce7-9959-e2383e1e0b2c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 09 21:23:14.085411 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 36/71] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:23:14.272119 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-6a52d53b-b14e-4d4c-9147-6dc36e55f514 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:14.275474 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6a52d53b-b14e-4d4c-9147-6dc36e55f514 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:14.275966 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6a52d53b-b14e-4d4c-9147-6dc36e55f514 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:14.276423 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6a52d53b-b14e-4d4c-9147-6dc36e55f514 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:14.277116 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6a52d53b-b14e-4d4c-9147-6dc36e55f514 admin admin] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:14.277553 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6a52d53b-b14e-4d4c-9147-6dc36e55f514 admin admin] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:14.277960 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6a52d53b-b14e-4d4c-9147-6dc36e55f514 admin admin] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:14.296991 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-6a52d53b-b14e-4d4c-9147-6dc36e55f514 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.076508 Sep 09 21:23:14.297462 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 36/72] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 21:23:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:23:25.803045 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-cf90805e-d1be-4ce7-9959-e2383e1e0b2c admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:25.804123 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-cf90805e-d1be-4ce7-9959-e2383e1e0b2c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 09 21:23:25.804521 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 37/73] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:23:25.946712 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell0:SELECT=4 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:25.947421 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell1:SELECT=4 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:25.948040 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=8 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:25.996066 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-851fd057-e512-47fa-a572-bbc2736b51c6 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:25.999398 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-851fd057-e512-47fa-a572-bbc2736b51c6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:25.999905 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-851fd057-e512-47fa-a572-bbc2736b51c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:26.000331 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-851fd057-e512-47fa-a572-bbc2736b51c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:26.001034 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-851fd057-e512-47fa-a572-bbc2736b51c6 admin admin] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:26.001478 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-851fd057-e512-47fa-a572-bbc2736b51c6 admin admin] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:26.001892 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-851fd057-e512-47fa-a572-bbc2736b51c6 admin admin] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:26.026362 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-851fd057-e512-47fa-a572-bbc2736b51c6 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.083967 Sep 09 21:23:26.026911 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 37/74] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 21:23:25 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:23:27.122676 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-cf90805e-d1be-4ce7-9959-e2383e1e0b2c admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:27.123710 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-cf90805e-d1be-4ce7-9959-e2383e1e0b2c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 09 21:23:27.124107 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 38/75] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Sep 9 21:23:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:23:27.319991 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-d67e69f8-ca1f-4e8f-b0f0-fbdc2a6fd904 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:27.323335 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d67e69f8-ca1f-4e8f-b0f0-fbdc2a6fd904 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:27.323824 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d67e69f8-ca1f-4e8f-b0f0-fbdc2a6fd904 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:27.324263 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d67e69f8-ca1f-4e8f-b0f0-fbdc2a6fd904 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:27.324959 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d67e69f8-ca1f-4e8f-b0f0-fbdc2a6fd904 admin admin] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:27.325393 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d67e69f8-ca1f-4e8f-b0f0-fbdc2a6fd904 admin admin] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:27.325826 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d67e69f8-ca1f-4e8f-b0f0-fbdc2a6fd904 admin admin] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:27.347300 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-d67e69f8-ca1f-4e8f-b0f0-fbdc2a6fd904 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.078816 Sep 09 21:23:27.347897 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 38/76] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Sep 9 21:23:27 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:24:23.388370 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: Fri Sep 9 21:24:23 2022 - graceful shutdown triggered... Sep 09 21:24:23.388878 dv-cinder-852210-15-iscsi devstack@n-api.service[105451]: Gracefully killing worker 2 (pid: 105451)... Sep 09 21:24:23.388498 dv-cinder-852210-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 21:24:23.389685 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: Gracefully killing worker 1 (pid: 105450)... Sep 09 21:24:23.516345 dv-cinder-852210-15-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=4 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:24:24.389523 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: worker 1 buried after 1 seconds Sep 09 21:24:24.390093 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: worker 2 buried after 1 seconds Sep 09 21:24:24.390093 dv-cinder-852210-15-iscsi devstack@n-api.service[105449]: goodbye to uWSGI. Sep 09 21:24:24.391129 dv-cinder-852210-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 21:24:24.391754 dv-cinder-852210-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 21:24:24.394516 dv-cinder-852210-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 21:24:24.404448 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 21:24:24.407124 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 21:24:24 2022] *** Sep 09 21:24:24.407282 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 21:24:24.407425 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 21:24:24.407584 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: nodename: dv-cinder-852210-15-iscsi Sep 09 21:24:24.407701 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: machine: x86_64 Sep 09 21:24:24.407811 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: clock source: unix Sep 09 21:24:24.407939 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: pcre jit disabled Sep 09 21:24:24.408049 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: detected number of CPU cores: 4 Sep 09 21:24:24.408420 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: current working directory: / Sep 09 21:24:24.408535 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: detected binary path: /usr/bin/uwsgi-core Sep 09 21:24:24.408651 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: your processes number limit is 47680 Sep 09 21:24:24.408771 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: your memory page size is 4096 bytes Sep 09 21:24:24.408882 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: detected max file descriptor number: 2048 Sep 09 21:24:24.408991 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: lock engine: pthread robust mutexes Sep 09 21:24:24.409270 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: thunder lock: enabled Sep 09 21:24:24.409589 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 21:24:24.409723 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 21:24:24.449176 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: Python main interpreter initialized at 0x562e9289d9c0 Sep 09 21:24:24.449176 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: python threads support enabled Sep 09 21:24:24.449176 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: your server socket listen backlog is limited to 100 connections Sep 09 21:24:24.449176 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: your mercy for graceful operations on workers is 90 seconds Sep 09 21:24:24.449649 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 21:24:24.449649 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: *** Operational MODE: preforking *** Sep 09 21:24:24.449895 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: *** uWSGI is running in multiple interpreter mode *** Sep 09 21:24:24.449895 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: spawned uWSGI master process (pid: 120444) Sep 09 21:24:24.450109 dv-cinder-852210-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 21:24:24.462473 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: spawned uWSGI worker 1 (pid: 120465, cores: 1) Sep 09 21:24:24.462473 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: spawned uWSGI worker 2 (pid: 120466, cores: 1) Sep 09 21:24:24.462473 dv-cinder-852210-15-iscsi devstack@n-api.service[120444]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 21:24:25.116349 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 21:24:25.127045 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 21:24:26.284239 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:24:26.284239 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: from cryptography.utils import int_from_bytes Sep 09 21:24:26.284883 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:24:26.284883 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: from cryptography.utils import int_from_bytes Sep 09 21:24:26.294495 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:24:26.294495 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: from cryptography.utils import int_from_bytes Sep 09 21:24:26.295006 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:24:26.295006 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: from cryptography.utils import int_from_bytes Sep 09 21:24:28.732101 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 21:24:28.732624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 21:24:28.732776 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 21:24:28.733142 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 21:24:28.733259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 21:24:28.733642 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 21:24:28.733734 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 21:24:28.733809 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.733974 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 21:24:28.734082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.734333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 21:24:28.734441 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.734595 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 21:24:28.734702 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.734979 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.735088 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.735291 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.735412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.735640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.735756 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.735954 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.736065 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.736279 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.736383 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.736534 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.736630 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.736852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.736969 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.737209 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.737333 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-15-iscsi {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.737544 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.737647 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.737809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.737913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.738130 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.738237 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.738499 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.738640 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-15-iscsi {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.738801 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.738945 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.739110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.739246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.739414 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.739571 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.739844 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.739990 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.740710 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.740882 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.741237 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.741469 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.741668 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.743126 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.743310 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.743467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.743680 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.743843 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.743999 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.744145 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.744299 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.744444 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.744604 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.744749 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.744895 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.745065 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.745214 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.745360 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.745518 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-15-iscsi {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.745690 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.745852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.746007 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.746152 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.751595 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.751714 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.751818 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.751910 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.751988 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-15-iscsi {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752094 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752179 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752345 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752419 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752501 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752597 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752671 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752762 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752847 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752926 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.752998 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753081 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753162 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753234 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753311 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753389 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753477 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753556 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753636 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753713 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753794 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753873 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.753977 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754127 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754197 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754354 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754354 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754531 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754610 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754683 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754758 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.754938 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.755062 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.755147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.755227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.755313 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.755393 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.755475 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.755576 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.755656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.755738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.755878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.756466 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.756548 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.756681 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.756872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.757000 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.757119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.757245 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.757392 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.757518 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.757632 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.757750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.757872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.757994 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.758114 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.758226 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.758336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.758456 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.758643 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.758770 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.758883 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.759002 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.759121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.759244 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.759366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.759480 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.759660 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.759778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.759902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.760016 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.760142 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.760279 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.760396 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.760516 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.760635 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.760756 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.760870 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.760980 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.761097 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.761216 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.761336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.761461 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.761573 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.761689 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.763016 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.763151 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.763274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.763397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.763518 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.763669 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.763791 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.763882 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.763962 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764043 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764123 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764416 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764489 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764637 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764716 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.764879 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.765919 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766012 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766176 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766256 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766343 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766425 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766498 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766568 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766810 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766884 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.766966 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767046 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767197 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767373 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767526 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767633 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767789 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767867 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.767946 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768025 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768103 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768184 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768262 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768334 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768412 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768485 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768647 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768730 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.768974 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.769045 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.769115 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.769186 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.769261 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.769342 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.769424 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.769503 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.769664 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.769756 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.769974 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.770065 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.770286 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.770390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.770612 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.770703 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.770925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.771106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.771235 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.771334 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.771596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.771684 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.771985 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.772631 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.772740 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.772845 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.772939 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.773032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.773125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.773218 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.773309 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.773406 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.773494 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.773572 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.773719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.773810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.774021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.774118 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.774324 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.774417 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.774626 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.774710 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.774925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.775066 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.775241 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.775333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.775696 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.775850 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.776150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.776281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.776401 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.776522 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.776522 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.776743 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.776872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.776984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.777103 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.777215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.777375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.777505 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.777704 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.777835 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.778022 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.778142 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.778337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.778471 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.778653 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.778782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.779021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:24:28.779148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.779267 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.779391 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.779601 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.779726 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.779927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.780048 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.780241 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.780376 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.780553 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.780689 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.780864 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.780994 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.781184 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.781306 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.781503 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.781629 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.781833 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.781952 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.782167 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.782296 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.782889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.783025 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.783141 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.783515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.783694 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.783827 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.783948 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.784061 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.784173 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.784284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.784401 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.784528 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.784648 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.784759 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.784877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.784990 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.785227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.785366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.785544 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.785666 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.785867 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.785997 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.786312 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.786447 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.786561 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.786672 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.786836 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.787472 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.787763 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.788029 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.788190 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.788517 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.788671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.788826 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.788981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.789134 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.789287 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.789433 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.789577 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.789728 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.789900 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.790056 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.790200 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.790344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.790497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.790650 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.790805 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.790949 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.791101 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.791991 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.792241 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.792409 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.792943 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.793124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.793272 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.793418 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.793582 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.794187 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.794347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.794504 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.794652 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.794796 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.794946 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.795204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.795369 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.795528 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.795909 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.796065 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.796218 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.796481 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.796643 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.796790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.796940 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.797208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.797355 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.797509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.797655 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.797655 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.797940 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.798092 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.798246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.798391 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.798542 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.798694 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.798840 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.798840 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.799128 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.799274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.799418 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.799582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.799745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.799909 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.800065 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.800219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.800372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.800372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.800644 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.800787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.800946 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.801099 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.801252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.801487 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.801640 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.801801 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.801961 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.802106 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.802348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.802510 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.803961 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.804135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.804293 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.804458 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.804605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.804750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.804902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.805056 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.805210 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.805414 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.805567 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.805720 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.805866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.806023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.806172 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.806316 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.806575 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.806741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.806902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.807048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.807306 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.807479 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.807653 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.807653 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.807947 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.808101 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.808254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.808408 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.808553 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.808706 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.808861 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.809013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.809167 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.809322 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.809478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.809478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.809775 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.809921 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.810072 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.810224 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.810381 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.810537 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.810690 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.810842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.810987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.811188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.811349 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.811639 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.811794 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.811947 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.812099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.812244 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.812477 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.812641 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.812798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.813040 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.813199 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.813345 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.813498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.813750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.814131 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.814286 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.814439 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.814585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.814811 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.814958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.815111 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.815256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.815451 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.815623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.815786 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.815938 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.816103 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.816256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.816407 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.816559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.816834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.816981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.817125 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.817853 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.818011 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.818164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.818325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.818479 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.818633 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.818792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.818945 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.819101 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.819247 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.819398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.819563 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.819726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.819881 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.820041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.820187 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.820331 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.820482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.820628 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.820628 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.820930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.821082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.821228 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.821372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.821523 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.821758 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.821921 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.822068 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.822212 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.822356 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.822518 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.822743 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.822943 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.823160 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.823318 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.823463 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.823635 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.823881 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.824398 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.824568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.824717 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.824888 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.825131 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.825292 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.825492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.825655 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.825808 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.825961 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.826114 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.826269 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.826423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.826568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.826730 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.826967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.827120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.827333 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.827486 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.827741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.827900 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.828046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.828302 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.828455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.828600 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.828745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.828889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.829033 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.829188 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.829335 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.829479 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.829623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.829786 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.829932 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.830087 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.830241 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.830388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.830539 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.830684 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.830836 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.830995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.831148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.831301 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.831447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.831692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.831952 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.832113 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.832260 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.832405 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.832555 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.832726 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.832957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.833119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.833354 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.833515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.833668 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.833823 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.835109 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.835295 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.835455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.835455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.835815 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.835970 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.836127 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.836281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.836427 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.836581 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.836727 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.836893 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.837155 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.837322 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.837468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.837621 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.837774 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.837933 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.838086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.838231 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.838504 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.838659 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.838815 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.838970 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.839124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.839270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.839433 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.839659 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.839824 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.839982 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.840128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.840281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.840434 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.840579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.840733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.840893 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.841047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.841199 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.841401 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.841569 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.841725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.841872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.842132 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.850473 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.850757 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.851017 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.851259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.851438 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.851607 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.851761 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.851918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.852063 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.852338 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.852493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.852493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.852782 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.852927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.853072 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.853226 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.853373 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.853517 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.853660 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.853811 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.853971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.854123 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.854301 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.854508 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.854654 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.854806 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.854965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.855111 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.855262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.855416 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.855582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.855735 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.855892 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.856045 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.856212 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.856212 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.856497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.856652 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.856797 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.856940 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.857084 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.857228 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.857379 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.857535 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.857691 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.858015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.858356 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.858533 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.858709 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.859119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.859281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.859281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.859678 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.859828 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.859980 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.860258 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.860422 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.860576 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.860576 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.860936 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.861092 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.861238 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.861381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.861535 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.861695 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.861849 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.862021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.862371 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.862597 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.862765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.862919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.862919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.863206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.863366 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.863525 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.863781 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.863929 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.864084 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.864230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.864388 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.864535 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.864686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.864831 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.864983 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.865188 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.865366 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.866030 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.866178 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.866178 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.866454 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.866608 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.866762 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.866916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.867070 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.867223 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.867397 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.868593 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.868758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.868939 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.869378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.869534 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.869681 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.869842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.869842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.870131 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.870351 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.870616 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.870769 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.870930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.871085 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.871243 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.871401 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.871574 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.871741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.871898 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.872044 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.872044 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.872331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.872483 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.872751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.872905 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.873059 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.873212 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.873379 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.873525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.873692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.880396 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.880823 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.881006 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.881213 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.881378 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.881543 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.881703 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.881861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.882010 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.882165 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.882342 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.882490 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.882644 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.882893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.883060 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.883209 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.883365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.883523 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.883697 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.883855 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.884009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.884155 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.884314 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.884479 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.884667 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.884838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.885031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.885191 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.885348 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.885348 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.885649 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.885837 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.885990 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.886150 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.886296 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.886441 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.886599 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.886786 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.886940 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.887095 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.887249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.887394 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.887566 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.887775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.887973 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.888131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.888277 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.888430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.888586 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.888731 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.888885 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.889158 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.889323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.889919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.890085 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.890233 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.890540 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.890703 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.890850 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.891101 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.891261 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.891490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.891681 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.891831 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.891983 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.892131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.892284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.892437 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.892593 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.892739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.892739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.893124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.893124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.893416 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.893587 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.893747 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.893900 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.894053 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.894199 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.894360 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.894513 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.894662 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.894807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.894961 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.895115 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.895271 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.895425 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.895643 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.895797 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.896142 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.896303 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.896572 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.896745 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.896892 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.897046 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.897237 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.897388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.897545 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.897700 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.897846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.898010 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.898158 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.898318 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.898466 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.898619 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.898766 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.898910 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.899054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.899207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.899354 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.899500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.900092 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.900259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.900406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.900698 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.900851 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.900998 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.901252 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.901414 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.901562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.901562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.901863 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.902018 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.902171 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.902326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.902498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.902645 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.902798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.902953 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.903126 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.903367 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.903586 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.903743 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.903889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.904033 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.904177 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.904322 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.904491 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.904660 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.904808 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.904961 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.905114 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.905267 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.905423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.905569 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.905721 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.905868 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.906021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.906166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.906324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.906471 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.906625 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.906768 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.906913 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.907138 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.907138 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.907416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.907592 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.907592 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.907885 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.908039 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.908455 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.908612 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.908766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.908766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.909070 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.909224 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.909370 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.909514 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.909666 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.910262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.910419 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.910626 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.910996 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.911147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.911147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.911567 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.911741 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.911889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.911889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.912692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.912847 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.913001 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.913169 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.913334 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.913563 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.913714 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.913867 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.914014 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.914186 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.914343 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.914496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.914642 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.914642 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.914946 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.915107 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.915263 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.915408 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.915574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.915737 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.915898 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.915898 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.916196 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.916343 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.916488 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.916634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.916793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.916948 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.917094 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.917254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.917402 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.917555 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.917710 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.917863 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.918026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.918181 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.918336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.918481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.918635 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.918788 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.918941 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.919087 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.919232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.919397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.919579 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.919744 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.919917 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.920481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.920638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.920881 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.921196 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.921342 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.921594 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.921757 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.921903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.922063 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.922210 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.922363 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.922510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.922657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.922812 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.922968 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.923120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.923266 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.923411 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.923731 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.923901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.924049 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.924193 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.924355 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.924650 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.924839 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.925021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.925824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.925985 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.926133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.926291 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.926447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.926594 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.926740 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.926885 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.927032 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.927192 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.927449 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.927693 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.928361 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.928510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.928666 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.928828 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.928975 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.929122 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.929275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.929421 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.929568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.929728 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.929877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.930030 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.930196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.930711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.930918 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.931175 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.931414 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.931624 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.931787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.932047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.932214 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.932361 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.932361 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.932361 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.932361 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.932896 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.933141 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.933291 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.933435 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.933580 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.933751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.933977 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.934145 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.934293 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.934452 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.934599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.934759 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.934919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.935076 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.935415 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.935600 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.935754 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.935907 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.936063 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.936219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.936365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.936510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.936656 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.936809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.936969 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.937116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.937272 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.937430 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.937585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.937731 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.937886 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.938033 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.938178 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.938324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.938476 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.938637 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.938792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.938937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.939082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.939237 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.939399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.940099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.940258 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.940776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.940974 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.941152 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.941379 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.941548 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.941704 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.941851 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.942005 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.942344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.942526 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.942684 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.942839 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.942996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.943151 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.943327 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.943455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.943708 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.943858 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.944098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.944262 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.944428 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.944619 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.944780 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.944936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.945083 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.945237 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.945384 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.945543 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.945691 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.945836 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.945989 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.946144 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.946307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.946468 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.946630 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.946795 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.947498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.947692 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.947854 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.947854 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.948299 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.948457 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.948612 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.948612 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.948907 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.949055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.949201 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.949357 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.949503 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.949655 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.949814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.949967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.950179 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.950179 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.950393 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.951112 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.951280 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.951526 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.951810 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.951963 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.952121 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.952486 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.952660 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.952807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.952971 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.953118 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.953270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.953426 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.953572 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.953716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.953868 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.954014 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.954260 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.954260 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.954565 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.954565 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.954856 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.955001 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.955145 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.955299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.955453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.955701 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.955883 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.956032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.956191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.956357 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.956503 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.956649 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.956831 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.956981 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.957137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.957291 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.957444 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.957590 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.957734 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.957914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.958073 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.958206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.958393 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.958604 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.958757 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.958983 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.959136 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.959400 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.959606 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.959769 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.959916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.960111 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.960262 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.960417 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.960574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.961251 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.962116 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.962116 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.962412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.962814 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.962973 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.963120 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.963300 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.963460 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.963700 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.963863 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.964019 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.964173 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.964432 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.964432 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.964739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.964896 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.965052 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.965210 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.965396 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.965547 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.965702 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.965860 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.966014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.966168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.966314 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.966466 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.966706 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.966854 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.967009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.967164 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.967310 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.967500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.967679 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.967838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.967984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.968129 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.968275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.968438 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.968592 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.968789 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.968951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.969099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.969253 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.969408 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.969588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.969751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.969904 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.970050 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.970204 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.970352 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.970506 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.970660 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.970833 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.971443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.971653 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.971816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.971972 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.972232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.972394 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.972548 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.972724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.973075 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.973237 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.973392 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.973547 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.973745 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.973900 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.974056 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.974210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.974356 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.975227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.975387 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.975494 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.975828 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.975975 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.976092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.976219 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.976219 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.976219 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.976219 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.976219 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.976219 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.976860 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.976998 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.977274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.977390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.977512 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.977666 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.977666 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.977928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978019 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978105 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978105 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978360 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978448 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978540 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978643 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978738 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978832 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.978927 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979380 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979468 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979623 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979714 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.979967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980056 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980314 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980408 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980504 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980504 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980661 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980661 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980823 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.980917 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.981013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.981013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.981495 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.981495 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.981495 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.981794 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.981896 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.981991 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.982077 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.982223 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.982223 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.982405 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.982500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.982587 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.982680 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.982765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.982849 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.982942 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983068 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983156 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983241 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983333 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983419 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983512 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983612 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983710 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983812 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983904 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.983998 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984084 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984169 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984251 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984341 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984433 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984531 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984617 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984701 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984701 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.984852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.985248 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.985339 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.985434 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.985531 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.985619 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.985711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.985902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986000 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986096 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986184 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986184 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986346 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986346 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986517 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986613 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986706 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986876 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.986876 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987030 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987030 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987363 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987363 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987526 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987526 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987719 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987811 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987897 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.987980 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988073 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988332 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988413 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988591 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988677 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988769 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988854 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.988945 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989037 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989200 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989288 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989372 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989642 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989737 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.989829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.990057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.990207 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.990798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.990887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.990981 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.991068 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.991154 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.991247 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.991350 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.991650 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.991750 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.991850 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.991937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992032 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992394 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992488 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992587 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992682 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.992950 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993048 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993142 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993315 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993406 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993591 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993591 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993756 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993843 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.993981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.994083 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.994180 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.994277 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.994377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.994464 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.994554 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.994649 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.994743 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.994830 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.994914 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.995001 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.995085 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.995183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.995276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.995369 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.995454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.995561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.995662 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.995751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.995897 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996067 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996168 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996265 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996366 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996455 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996541 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996626 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996626 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996779 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996876 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.996971 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997064 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997159 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997245 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997336 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997431 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997527 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997527 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997690 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997776 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997869 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.997964 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998051 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998311 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998410 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998581 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998664 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998840 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.998935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.999022 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.999106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.999190 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.999279 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.999376 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.999470 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.999718 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.999718 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:28.999964 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.000086 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.000210 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.000338 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.000434 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.000529 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.000622 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.000756 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.000883 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.000883 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.001110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.001233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.001346 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.001459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.002660 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.002834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.002995 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.003144 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.003293 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.003456 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.003640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.003792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.003936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.004400 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.004566 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.004731 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.004882 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.005029 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.005269 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.005454 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.005604 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.006277 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.006493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.006668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.006816 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.006914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007005 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007125 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007222 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007318 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007404 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007637 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007920 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.007994 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008073 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008148 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008226 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008453 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008532 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008613 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008843 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.008925 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.009006 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.009079 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.009157 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.009818 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.009916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010003 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010079 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010151 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010222 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010303 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010385 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010473 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010555 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010630 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010701 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010780 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.010943 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.011020 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.011101 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.011182 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.011261 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.011335 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.011416 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.011490 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.011675 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.011756 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012035 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012111 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012204 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012289 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012363 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012435 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012587 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012675 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012911 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012990 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.012990 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013134 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013134 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013272 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013272 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 21:24:29.013459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.013459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.014752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.015593 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:24:29.015593 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 21:24:29.070735 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO dbcounter [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Registered counter for database nova_api Sep 09 21:24:29.074643 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO dbcounter [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Registered counter for database nova_api Sep 09 21:24:29.092083 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_db.sqlalchemy.engines [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:24:29.095737 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_db.sqlalchemy.engines [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:24:29.101636 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writer thread running {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:24:29.103006 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writer thread running {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:24:29.157978 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.context [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b917e871-a448-4561-a39a-585fcf48a3c9(cell1) {{(pid=120465) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 21:24:29.159574 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.context [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b917e871-a448-4561-a39a-585fcf48a3c9(cell1) {{(pid=120466) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 21:24:29.162888 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:29.163365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:29.164344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:29.164829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:29.164929 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:29.165664 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:29.166111 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:29.166386 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:29.167133 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:29.167621 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:29.168114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:29.169617 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:29.170101 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO dbcounter [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Registered counter for database nova_cell0 Sep 09 21:24:29.171627 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO dbcounter [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Registered counter for database nova_cell0 Sep 09 21:24:29.174168 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO dbcounter [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Registered counter for database nova_cell1 Sep 09 21:24:29.175653 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO dbcounter [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Registered counter for database nova_cell1 Sep 09 21:24:29.182163 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_db.sqlalchemy.engines [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:24:29.184482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_db.sqlalchemy.engines [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:24:29.185718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_db.sqlalchemy.engines [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:24:29.187058 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writer thread running {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:24:29.187752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_db.sqlalchemy.engines [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:24:29.192404 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writer thread running {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:24:29.194333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writer thread running {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:24:29.337090 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writer thread running {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:24:29.340290 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO dbcounter [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Registered counter for database nova_cell0 Sep 09 21:24:29.346377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO dbcounter [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Registered counter for database nova_cell0 Sep 09 21:24:29.347094 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_db.sqlalchemy.engines [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:24:29.353037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writer thread running {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:24:29.355929 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_db.sqlalchemy.engines [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:24:29.360653 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writer thread running {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:24:29.671790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: WARNING keystonemiddleware.auth_token [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:24:29.679216 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: WARNING keystonemiddleware.auth_token [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:24:29.684453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: WARNING keystonemiddleware.auth_token [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:24:29.691648 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: WARNING keystonemiddleware.auth_token [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:24:30.029049 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: WARNING keystonemiddleware.auth_token [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:24:30.035827 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: WARNING keystonemiddleware.auth_token [None req-641f4196-52d2-479c-80e6-b3dd98983424 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:24:30.039870 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: WARNING keystonemiddleware.auth_token [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:24:30.042358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562e9289d9c0 pid: 120466 (default app) Sep 09 21:24:30.045811 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: WARNING keystonemiddleware.auth_token [None req-b10f94f7-6273-4543-bff1-22aa779bfd9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:24:30.051015 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562e9289d9c0 pid: 120465 (default app) Sep 09 21:25:06.904616 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=3 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:06.907817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=3 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:06.909730 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=3 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:06.922164 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=3 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:07.686301 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0c8c222c-5247-4043-8439-690a28a09647 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Action: 'create', calling method: .version_select at 0x7f0813ef33a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1716291645", "metadata": {"Type": "work"}}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0c8c222c-5247-4043-8439-690a28a09647 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Request method failure captured: Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 122 Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG68yWUjHex8m2QsP4o9gG7_4cqV0uAVZcwwYoPmDF7TUai2GIdg-CbQVnyieCvJy5Bt8b0OT5_2nVKdRFqe0UdKJv_Yy5rNcLekDCGLxinRAFJq03hsBurJxrVfnaX6Dz4X--H3L8WtAaBy7T6F7KlXzumwf5ryG_yYVeRQf-pU_Vlc Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:25:07.695965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1ec4f49f69a843d4abd5eb912b518106", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1ec4f49f69a843d4abd5eb912b518106"}]}] Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 38636a9bf3e24c5691c08d144385b396 Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1716291645", "metadata": {"Type": "work"}}} Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: Sep 09 21:25:07.697492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1716291645', 'metadata': {'Type': 'work'}}}} Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise error Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:25:07.698415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 21:25:07.701648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 21:25:07.704335 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 21:25:07.704335 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.705958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0c8c222c-5247-4043-8439-690a28a09647 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:25:07.707435 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0c8c222c-5247-4043-8439-690a28a09647 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.829107 Sep 09 21:25:07.709809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1156 bytes} [Fri Sep 9 21:25:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 833 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 21:25:07.723498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-30f5a483-0fb6-465d-9aef-691e096e3d21 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Action: 'create', calling method: .version_select at 0x7f0813ef3f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1235862090", "metadata": {"Type": "work"}}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-30f5a483-0fb6-465d-9aef-691e096e3d21 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Request method failure captured: Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 120 Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG68yWUjHex8m2QsP4o9gG7_4cqV0uAVZcwwYoPmDF7TUai2GIdg-CbQVnyieCvJy5Bt8b0OT5_2nVKdRFqe0UdKJv_Yy5rNcLekDCGLxinRAFJq03hsBurJxrVfnaX6Dz4X--H3L8WtAaBy7T6F7KlXzumwf5ryG_yYVeRQf-pU_Vlc Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:25:07.734866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1ec4f49f69a843d4abd5eb912b518106", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1ec4f49f69a843d4abd5eb912b518106"}]}] Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 38636a9bf3e24c5691c08d144385b396 Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1235862090", "metadata": {"Type": "work"}}} Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: Sep 09 21:25:07.736348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1235862090', 'metadata': {'Type': 'work'}}}} Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise error Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi '0' Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:25:07.737128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 21:25:07.738982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 21:25:07.742234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 21:25:07.742234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.742234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-30f5a483-0fb6-465d-9aef-691e096e3d21 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:25:07.742234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-30f5a483-0fb6-465d-9aef-691e096e3d21 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020869 Sep 09 21:25:07.742234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 2/2] 10.222.0.46 () {60 vars in 1156 bytes} [Fri Sep 9 21:25:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:25:07.756142 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-57c2da96-373d-44fd-bc3b-763385166301 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Action: 'create', calling method: .version_select at 0x7f0813daf160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1046119018", "metadata": {"Type": "work"}}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-57c2da96-373d-44fd-bc3b-763385166301 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Request method failure captured: Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 119 Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG68yWUjHex8m2QsP4o9gG7_4cqV0uAVZcwwYoPmDF7TUai2GIdg-CbQVnyieCvJy5Bt8b0OT5_2nVKdRFqe0UdKJv_Yy5rNcLekDCGLxinRAFJq03hsBurJxrVfnaX6Dz4X--H3L8WtAaBy7T6F7KlXzumwf5ryG_yYVeRQf-pU_Vlc Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:25:07.760816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1ec4f49f69a843d4abd5eb912b518106", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1ec4f49f69a843d4abd5eb912b518106"}]}] Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 38636a9bf3e24c5691c08d144385b396 Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1046119018", "metadata": {"Type": "work"}}} Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: Sep 09 21:25:07.762092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1046119018', 'metadata': {'Type': 'work'}}}} Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise error Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi '' Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:25:07.762878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 21:25:07.764208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 21:25:07.765297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 21:25:07.765297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:07.765297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-57c2da96-373d-44fd-bc3b-763385166301 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:25:07.765297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-57c2da96-373d-44fd-bc3b-763385166301 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018086 Sep 09 21:25:07.770378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 3/3] 10.222.0.46 () {60 vars in 1156 bytes} [Fri Sep 9 21:25:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:25:07.784881 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-202dfba5-b163-4a66-ba91-7bea99cd02dc tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Calling method '.version_select at 0x7f0813dafc10>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:07.896328 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f8b2dece-024f-42ea-bb81-d7c1a0d980c8 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813f9f4c0>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:07.928891 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:07.930322 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:07.931429 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:07.932818 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:08.500300 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-202dfba5-b163-4a66-ba91-7bea99cd02dc tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] HTTP exception thrown: Volume tempest-invalid-734403287 could not be found. Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-202dfba5-b163-4a66-ba91-7bea99cd02dc tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Request method failure captured: Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-734403287 HTTP/1.1 Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG68yWUjHex8m2QsP4o9gG7_4cqV0uAVZcwwYoPmDF7TUai2GIdg-CbQVnyieCvJy5Bt8b0OT5_2nVKdRFqe0UdKJv_Yy5rNcLekDCGLxinRAFJq03hsBurJxrVfnaX6Dz4X--H3L8WtAaBy7T6F7KlXzumwf5ryG_yYVeRQf-pU_Vlc Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:25:08.504509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1ec4f49f69a843d4abd5eb912b518106", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1ec4f49f69a843d4abd5eb912b518106"}]}] Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 38636a9bf3e24c5691c08d144385b396 Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Volume tempest-invalid-734403287 could not be found. Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': 'tempest-invalid-734403287'} Sep 09 21:25:08.505935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-734403287 could not be found. (HTTP 404) (Request-ID: req-1de518c1-fada-4346-9116-fff95722673c) Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:08.506702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:25:08.507948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-734403287 could not be found. Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:25:08.511944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-734403287 could not be found. Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-734403287 could not be found. Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-202dfba5-b163-4a66-ba91-7bea99cd02dc tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Returning 404 to user: Volume tempest-invalid-734403287 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-202dfba5-b163-4a66-ba91-7bea99cd02dc tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-734403287" status: 404 len: 98 microversion: 2.1 time: 0.731453 Sep 09 21:25:08.515298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 4/4] 10.222.0.46 () {58 vars in 1215 bytes} [Fri Sep 9 21:25:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-734403287 => generated 98 bytes in 733 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 09 21:25:08.524835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-09b3861f-cacf-41a5-9c01-047b5e8e64c6 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004223 Sep 09 21:25:08.525425 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 5/5] 10.222.0.46 () {58 vars in 1140 bytes} [Fri Sep 9 21:25:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 21:25:08.547383 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-256e88e2-962d-4d3e-83f0-50d37465f815 tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014306 Sep 09 21:25:08.548103 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 6/6] 10.222.0.46 () {58 vars in 1137 bytes} [Fri Sep 9 21:25:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 21:25:08.567415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c42a530b-6f9c-4d07-956c-1f612ac16e6f tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Calling method '.version_select at 0x7f0813cde3a0>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:08.675040 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-c42a530b-6f9c-4d07-956c-1f612ac16e6f tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] HTTP exception thrown: Volume 24cf89af-b984-4ee8-b9e7-e07c9c0faf23 could not be found. Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c42a530b-6f9c-4d07-956c-1f612ac16e6f tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Request method failure captured: Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/os-volumes/24cf89af-b984-4ee8-b9e7-e07c9c0faf23 HTTP/1.1 Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG68yWUjHex8m2QsP4o9gG7_4cqV0uAVZcwwYoPmDF7TUai2GIdg-CbQVnyieCvJy5Bt8b0OT5_2nVKdRFqe0UdKJv_Yy5rNcLekDCGLxinRAFJq03hsBurJxrVfnaX6Dz4X--H3L8WtAaBy7T6F7KlXzumwf5ryG_yYVeRQf-pU_Vlc Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:25:08.679809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1ec4f49f69a843d4abd5eb912b518106", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1ec4f49f69a843d4abd5eb912b518106"}]}] Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 38636a9bf3e24c5691c08d144385b396 Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Volume 24cf89af-b984-4ee8-b9e7-e07c9c0faf23 could not be found. Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '24cf89af-b984-4ee8-b9e7-e07c9c0faf23'} Sep 09 21:25:08.681724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 24cf89af-b984-4ee8-b9e7-e07c9c0faf23 could not be found. (HTTP 404) (Request-ID: req-701aa2bc-0d14-46e7-a6a3-c03a423c173b) Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:08.682592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:25:08.683829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 24cf89af-b984-4ee8-b9e7-e07c9c0faf23 could not be found. Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 21:25:08.684971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 24cf89af-b984-4ee8-b9e7-e07c9c0faf23 could not be found. Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 24cf89af-b984-4ee8-b9e7-e07c9c0faf23 could not be found. Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c42a530b-6f9c-4d07-956c-1f612ac16e6f tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Returning 404 to user: Volume 24cf89af-b984-4ee8-b9e7-e07c9c0faf23 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c42a530b-6f9c-4d07-956c-1f612ac16e6f tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/24cf89af-b984-4ee8-b9e7-e07c9c0faf23" status: 404 len: 109 microversion: 2.1 time: 0.125384 Sep 09 21:25:08.686095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 7/7] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:25:08 2022] DELETE /compute/v2.1/os-volumes/24cf89af-b984-4ee8-b9e7-e07c9c0faf23 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:25:08.699777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-392421e4-6b9e-42bc-8b11-1e37eb7360bf tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Calling method '.version_select at 0x7f0813cde280>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:08.827633 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f8b2dece-024f-42ea-bb81-d7c1a0d980c8 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2a634fec-7932-44c6-a582-571c8867c721" status: 200 len: 350 microversion: 2.1 time: 1.181452 Sep 09 21:25:08.836935 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 1/8] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:25:07 2022] GET /compute/v2.1/os-volumes/2a634fec-7932-44c6-a582-571c8867c721 => generated 350 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:25:09.236358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-392421e4-6b9e-42bc-8b11-1e37eb7360bf tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] HTTP exception thrown: Volume 5e12d518-6689-462f-b3e2-3658ecbf9059 could not be found. Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-392421e4-6b9e-42bc-8b11-1e37eb7360bf tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Request method failure captured: Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/os-volumes/5e12d518-6689-462f-b3e2-3658ecbf9059 HTTP/1.1 Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG68yWUjHex8m2QsP4o9gG7_4cqV0uAVZcwwYoPmDF7TUai2GIdg-CbQVnyieCvJy5Bt8b0OT5_2nVKdRFqe0UdKJv_Yy5rNcLekDCGLxinRAFJq03hsBurJxrVfnaX6Dz4X--H3L8WtAaBy7T6F7KlXzumwf5ryG_yYVeRQf-pU_Vlc Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:25:09.241207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1ec4f49f69a843d4abd5eb912b518106", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1ec4f49f69a843d4abd5eb912b518106"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1ec4f49f69a843d4abd5eb912b518106"}]}] Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 1ec4f49f69a843d4abd5eb912b518106 Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesNegativeTest-808707827 Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 38636a9bf3e24c5691c08d144385b396 Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesNegativeTest-808707827-project Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Volume 5e12d518-6689-462f-b3e2-3658ecbf9059 could not be found. Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '5e12d518-6689-462f-b3e2-3658ecbf9059'} Sep 09 21:25:09.243038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e12d518-6689-462f-b3e2-3658ecbf9059 could not be found. (HTTP 404) (Request-ID: req-f228885e-4848-4cc6-926e-cfb21eb3acf6) Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:09.244057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:25:09.245546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e12d518-6689-462f-b3e2-3658ecbf9059 could not be found. Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 21:25:09.247230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5e12d518-6689-462f-b3e2-3658ecbf9059 could not be found. Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e12d518-6689-462f-b3e2-3658ecbf9059 could not be found. Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-392421e4-6b9e-42bc-8b11-1e37eb7360bf tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] Returning 404 to user: Volume 5e12d518-6689-462f-b3e2-3658ecbf9059 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-392421e4-6b9e-42bc-8b11-1e37eb7360bf tempest-VolumesNegativeTest-808707827 tempest-VolumesNegativeTest-808707827-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/5e12d518-6689-462f-b3e2-3658ecbf9059" status: 404 len: 109 microversion: 2.1 time: 0.553533 Sep 09 21:25:09.248752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 8/9] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:25:08 2022] GET /compute/v2.1/os-volumes/5e12d518-6689-462f-b3e2-3658ecbf9059 => generated 109 bytes in 556 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:25:11.287015 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7e86326b-aac8-4a8b-ba80-1a723d567f7d tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813d9f280>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:11.461705 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7e86326b-aac8-4a8b-ba80-1a723d567f7d tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/52c53b5f-15bb-4f3e-90fe-2861aa49366b" status: 200 len: 350 microversion: 2.1 time: 0.180109 Sep 09 21:25:11.471133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 2/10] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:25:11 2022] GET /compute/v2.1/os-volumes/52c53b5f-15bb-4f3e-90fe-2861aa49366b => generated 350 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:25:18.773257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1915742357", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "networks": [{"uuid": "9c2b4060-2f71-4ce6-bea1-005dcf7fbef9"}]}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:18.964120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] validate_networks() for [('9c2b4060-2f71-4ce6-bea1-005dcf7fbef9', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:25:19.098152 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e0d5564e-8e2b-4383-b8e1-c37485351d86 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813d9f430>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:19.236079 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e0d5564e-8e2b-4383-b8e1-c37485351d86 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/76842576-69ac-425e-a53e-51a02ecbab81" status: 200 len: 350 microversion: 2.1 time: 0.143799 Sep 09 21:25:19.237196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 3/11] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:25:19 2022] GET /compute/v2.1/os-volumes/76842576-69ac-425e-a53e-51a02ecbab81 => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:25:19.254398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-16d411e6-5a97-42d4-89b2-37e3aa626471 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813d9f940>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:19.442398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-16d411e6-5a97-42d4-89b2-37e3aa626471 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.194516 Sep 09 21:25:19.444502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 4/12] 10.222.0.46 () {58 vars in 1134 bytes} [Fri Sep 9 21:25:19 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:19.461865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9286edb8-d8f6-469c-85ff-80ecba283275 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813d9f160>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:19.585735 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9286edb8-d8f6-469c-85ff-80ecba283275 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.129489 Sep 09 21:25:19.586317 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 5/13] 10.222.0.46 () {58 vars in 1149 bytes} [Fri Sep 9 21:25:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:25:19.606850 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7b7225db-366a-4f6c-ae50-ad1f00212140 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813dd15e0>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:19.776558 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7b7225db-366a-4f6c-ae50-ad1f00212140 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.174393 Sep 09 21:25:19.788858 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 6/14] 10.222.0.46 () {58 vars in 1134 bytes} [Fri Sep 9 21:25:19 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:25:19.796303 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1ff2effb-8153-439d-b9db-7f03af1fd3fc tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813dd1790>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:19.996963 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1ff2effb-8153-439d-b9db-7f03af1fd3fc tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.205173 Sep 09 21:25:20.012940 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 7/15] 10.222.0.46 () {58 vars in 1167 bytes} [Fri Sep 9 21:25:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:25:20.018014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-da5ed17c-1a70-41e0-ad23-5067df0a5e28 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813d9f430>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:20.197524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-da5ed17c-1a70-41e0-ad23-5067df0a5e28 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.183269 Sep 09 21:25:20.199447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1170 bytes} [Fri Sep 9 21:25:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:25:20.217717 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1ff69c14-8dc2-4ef6-8d5f-61492efedc9f tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813d56670>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:20.450559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1ff69c14-8dc2-4ef6-8d5f-61492efedc9f tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.236766 Sep 09 21:25:20.451281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 9/17] 10.222.0.46 () {58 vars in 1155 bytes} [Fri Sep 9 21:25:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:20.474486 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8f059611-6049-414a-90b4-145f82e4c5ba tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813dd1700>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:20.694970 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8f059611-6049-414a-90b4-145f82e4c5ba tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.228224 Sep 09 21:25:20.696565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 10/18] 10.222.0.46 () {58 vars in 1188 bytes} [Fri Sep 9 21:25:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:25:20.713714 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2af9fe1b-4d4b-44db-8801-39d2f0dfc820 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] Calling method '.version_select at 0x7f0813db80d0>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:20.936898 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2af9fe1b-4d4b-44db-8801-39d2f0dfc820 tempest-VolumesTestJSON-1344814026 tempest-VolumesTestJSON-1344814026-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.227620 Sep 09 21:25:20.937552 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 11/19] 10.222.0.46 () {58 vars in 1155 bytes} [Fri Sep 9 21:25:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:25:21.937872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:25:21.938375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:25:21.938771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:25:21.939315 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:25:21.939765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:25:21.981627 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:21.982109 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:21.982551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:21.983282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:21.997396 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:21.997966 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:22.088412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Getting quotas for project 777c1bff7c024f91b0eafcad7fce29bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:25:22.097768 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Getting quotas for user afd147dfc8c648149712518771f7940c and project 777c1bff7c024f91b0eafcad7fce29bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:25:22.130624 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:25:22.139811 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:25:22.323246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c16795cf-aaf3-4a1f-8fa5-feaad3e683b7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.876857 Sep 09 21:25:22.324515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 9/20] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:25:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:25:22.355800 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0e4ae45d-7596-481f-bed8-3e9f34109de1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:22.355800 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0e4ae45d-7596-481f-bed8-3e9f34109de1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:22.496890 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0e4ae45d-7596-481f-bed8-3e9f34109de1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:22.524101 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0e4ae45d-7596-481f-bed8-3e9f34109de1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1215 microversion: 2.1 time: 0.191174 Sep 09 21:25:22.525316 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 12/21] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:22 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:23.550591 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-73fb25a7-6069-4fae-93f3-8c962349e560 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:23.553059 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-73fb25a7-6069-4fae-93f3-8c962349e560 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:23.775750 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-73fb25a7-6069-4fae-93f3-8c962349e560 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:23.839993 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-73fb25a7-6069-4fae-93f3-8c962349e560 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1215 microversion: 2.1 time: 0.295406 Sep 09 21:25:23.848325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 10/22] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:23 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1215 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:24.620411 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-557f872e-9e3d-466c-b3db-3cb289fde9f6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Action: 'create', calling method: .version_select at 0x7f0813db8d30>, body: {"keypair": {"name": "tempest-keypair-1437852790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4pFDQXQxbjk2lxDkY3q0BQJgIaDXZ9uEMA9dFUuiYDDY6Q033upRh9aY97kxfIXnEG33xpQxwA6/jlyZiVZWxjcoqcEKe2uUWlWFG4s6QeITtBhpNucddgOuWukUcD3w=="}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:24.833429 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-557f872e-9e3d-466c-b3db-3cb289fde9f6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Getting quotas for project ec1c332dc5c44eee9c7c81787a435533. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:25:24.850932 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-557f872e-9e3d-466c-b3db-3cb289fde9f6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Getting quotas for user 85a24cb16a864a03920ccb359c13ec79 and project ec1c332dc5c44eee9c7c81787a435533. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:25:24.876589 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-bb1e0cd7-27d7-4c23-b348-30a6dcb4cfd0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:24.879363 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-bb1e0cd7-27d7-4c23-b348-30a6dcb4cfd0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:24.897765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb1e0cd7-27d7-4c23-b348-30a6dcb4cfd0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:24.900834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb1e0cd7-27d7-4c23-b348-30a6dcb4cfd0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:24.904137 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb1e0cd7-27d7-4c23-b348-30a6dcb4cfd0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:24.905380 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb1e0cd7-27d7-4c23-b348-30a6dcb4cfd0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:24.907342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb1e0cd7-27d7-4c23-b348-30a6dcb4cfd0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:24.909531 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb1e0cd7-27d7-4c23-b348-30a6dcb4cfd0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:25.018450 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-557f872e-9e3d-466c-b3db-3cb289fde9f6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.147725 Sep 09 21:25:25.023373 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 13/23] 10.222.0.46 () {62 vars in 1200 bytes} [Fri Sep 9 21:25:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 21:25:25.398891 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-bb1e0cd7-27d7-4c23-b348-30a6dcb4cfd0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:25.463397 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-bb1e0cd7-27d7-4c23-b348-30a6dcb4cfd0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1211 microversion: 2.1 time: 0.600786 Sep 09 21:25:25.480036 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 11/24] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:24 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1211 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:25.843007 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2a025212-baae-4ff5-bb2d-c0a4574b9788 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'create', calling method: .version_select at 0x7f0813d07160>, body: {"keypair": {"name": "tempest-keypair-1797152783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONXIVWfFu47cSg+9KIPGx2D4HNfrWTWQYW4uFtR8sCNiQyFSTWB3ySvB8upz4tSuHnLd6eL7KZ07FGStf8001tSlsGlGCoPJ5POLTYEq1HW6IrwKBXNto2ku4MZXh9QYg=="}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:25.876964 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-2a025212-baae-4ff5-bb2d-c0a4574b9788 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Getting quotas for project bc8ed5f414b947e2ab1815f5a775a2c5. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:25:25.886674 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-2a025212-baae-4ff5-bb2d-c0a4574b9788 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Getting quotas for user 8c37b14f268f4180a618aa8eeefb5bc6 and project bc8ed5f414b947e2ab1815f5a775a2c5. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:25:25.956806 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2a025212-baae-4ff5-bb2d-c0a4574b9788 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.931535 Sep 09 21:25:25.965759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 14/25] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 21:25:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:25:26.494548 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-971ae339-8929-4c0a-a5bb-e3c5fc0f2bef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:26.495292 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-971ae339-8929-4c0a-a5bb-e3c5fc0f2bef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:26.508442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-971ae339-8929-4c0a-a5bb-e3c5fc0f2bef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:26.510506 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-971ae339-8929-4c0a-a5bb-e3c5fc0f2bef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:26.511754 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-971ae339-8929-4c0a-a5bb-e3c5fc0f2bef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:26.513661 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-971ae339-8929-4c0a-a5bb-e3c5fc0f2bef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:26.514886 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-971ae339-8929-4c0a-a5bb-e3c5fc0f2bef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:26.515652 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-971ae339-8929-4c0a-a5bb-e3c5fc0f2bef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:27.169588 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-971ae339-8929-4c0a-a5bb-e3c5fc0f2bef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:27.187839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-971ae339-8929-4c0a-a5bb-e3c5fc0f2bef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1273 microversion: 2.1 time: 0.697453 Sep 09 21:25:27.209507 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 12/26] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:26 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1273 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:28.216006 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e324ec96-dcb4-4936-8d43-c100d346fc44 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:28.216634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e324ec96-dcb4-4936-8d43-c100d346fc44 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:28.246914 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e324ec96-dcb4-4936-8d43-c100d346fc44 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:28.256238 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e324ec96-dcb4-4936-8d43-c100d346fc44 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:28.264713 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e324ec96-dcb4-4936-8d43-c100d346fc44 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:28.286579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e324ec96-dcb4-4936-8d43-c100d346fc44 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:28.293066 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e324ec96-dcb4-4936-8d43-c100d346fc44 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:28.297184 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e324ec96-dcb4-4936-8d43-c100d346fc44 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:29.430195 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e324ec96-dcb4-4936-8d43-c100d346fc44 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:29.460476 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e324ec96-dcb4-4936-8d43-c100d346fc44 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 1.248867 Sep 09 21:25:29.469756 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 15/27] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:28 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:30.497310 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-630bf1ac-7802-47df-bd98-9fdfee4dc6ef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:30.497926 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-630bf1ac-7802-47df-bd98-9fdfee4dc6ef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:30.540339 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-630bf1ac-7802-47df-bd98-9fdfee4dc6ef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:30.541528 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-630bf1ac-7802-47df-bd98-9fdfee4dc6ef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:30.542482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-630bf1ac-7802-47df-bd98-9fdfee4dc6ef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:30.543630 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-630bf1ac-7802-47df-bd98-9fdfee4dc6ef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:30.544493 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-630bf1ac-7802-47df-bd98-9fdfee4dc6ef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:30.545196 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-630bf1ac-7802-47df-bd98-9fdfee4dc6ef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:30.724930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1556319757", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "192eabe0-1e5d-4d95-b42d-c42257bcd236"}], "security_groups": [{"name": "tempest-securitygroup--1653552340"}], "key_name": "tempest-keypair-1797152783", "user_data": "}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:31.045961 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.network.neutron [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] validate_networks() for [('192eabe0-1e5d-4d95-b42d-c42257bcd236', None, None, None, None, None)] {{(pid=120465) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:25:31.075132 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-630bf1ac-7802-47df-bd98-9fdfee4dc6ef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:31.106322 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-630bf1ac-7802-47df-bd98-9fdfee4dc6ef tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.613344 Sep 09 21:25:31.111234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 13/28] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:30 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:31.674609 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2131625570", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7dc3250f-6619-48e3-826b-3b813ae4b435"}], "security_groups": [{"name": "tempest-securitygroup--1391227064"}], "key_name": "tempest-keypair-1437852790", "user_data": "}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:31.877599 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] validate_networks() for [('7dc3250f-6619-48e3-826b-3b813ae4b435', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:25:32.036115 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:32.444925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Flavor limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:25:32.445463 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Image limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:25:32.446392 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Flavor pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:25:32.446392 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Image pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:25:32.446625 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:25:32.464592 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:32.465082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:32.465521 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:32.466249 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:32.466890 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:32.467472 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:32.493342 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Getting quotas for project bc8ed5f414b947e2ab1815f5a775a2c5. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:25:32.498375 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Getting quotas for user 8c37b14f268f4180a618aa8eeefb5bc6 and project bc8ed5f414b947e2ab1815f5a775a2c5. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:25:32.512299 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Going to run 1 instances... {{(pid=120465) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:25:32.516250 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:25:32.674447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-93723b2d-ad4c-4a36-a37d-8ae095feb236 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.956480 Sep 09 21:25:32.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 16/29] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:25:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:25:32.699985 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4a8716e3-fc1b-4c3b-8160-14a6ac4ff151 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:32.701339 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4a8716e3-fc1b-4c3b-8160-14a6ac4ff151 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:32.722088 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a8716e3-fc1b-4c3b-8160-14a6ac4ff151 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:32.725229 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a8716e3-fc1b-4c3b-8160-14a6ac4ff151 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:32.727192 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a8716e3-fc1b-4c3b-8160-14a6ac4ff151 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:32.730283 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a8716e3-fc1b-4c3b-8160-14a6ac4ff151 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:32.731774 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a8716e3-fc1b-4c3b-8160-14a6ac4ff151 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:32.733001 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a8716e3-fc1b-4c3b-8160-14a6ac4ff151 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:32.831046 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:25:32.831721 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:25:32.831978 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:25:32.832396 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:25:32.833396 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:25:32.852456 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:32.852956 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:32.853402 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:32.855178 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:32.856833 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:32.857394 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:32.885511 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Getting quotas for project ec1c332dc5c44eee9c7c81787a435533. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:25:32.926963 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Getting quotas for user 85a24cb16a864a03920ccb359c13ec79 and project ec1c332dc5c44eee9c7c81787a435533. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:25:32.938944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:25:32.941582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:25:33.077712 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5a15eb7e-f6b3-472b-bf25-74d40a8ae910 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.407429 Sep 09 21:25:33.078385 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 14/30] 10.222.0.46 () {62 vars in 1188 bytes} [Fri Sep 9 21:25:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 09 21:25:33.102206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-86d217da-f171-4d0d-bba0-0a1b17355913 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:33.102832 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-86d217da-f171-4d0d-bba0-0a1b17355913 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:33.222673 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4a8716e3-fc1b-4c3b-8160-14a6ac4ff151 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:33.234584 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4a8716e3-fc1b-4c3b-8160-14a6ac4ff151 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.550872 Sep 09 21:25:33.235300 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 17/31] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:32 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:33.253932 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-28463137-6df1-4b75-ad7e-1ac2b107ed6e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:33.255716 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-28463137-6df1-4b75-ad7e-1ac2b107ed6e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:33.293991 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-86d217da-f171-4d0d-bba0-0a1b17355913 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:33.308871 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-86d217da-f171-4d0d-bba0-0a1b17355913 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1238 microversion: 2.1 time: 0.218586 Sep 09 21:25:33.310658 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 15/32] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:33 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1238 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:33.371434 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-28463137-6df1-4b75-ad7e-1ac2b107ed6e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:33.390940 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-28463137-6df1-4b75-ad7e-1ac2b107ed6e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:33.396058 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-28463137-6df1-4b75-ad7e-1ac2b107ed6e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:33.410662 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-28463137-6df1-4b75-ad7e-1ac2b107ed6e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1282 microversion: 2.20 time: 0.173084 Sep 09 21:25:33.412784 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 18/33] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:33 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:34.275114 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2863f7dc-ba28-4de2-95da-42696a7386e5 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:34.275997 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2863f7dc-ba28-4de2-95da-42696a7386e5 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:34.292400 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2863f7dc-ba28-4de2-95da-42696a7386e5 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:34.294583 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2863f7dc-ba28-4de2-95da-42696a7386e5 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:34.296104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2863f7dc-ba28-4de2-95da-42696a7386e5 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:34.298021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2863f7dc-ba28-4de2-95da-42696a7386e5 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:34.299963 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2863f7dc-ba28-4de2-95da-42696a7386e5 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2863f7dc-ba28-4de2-95da-42696a7386e5 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:34.343187 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-052f29d3-941c-4d25-8f56-4b089c5e810e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:34.343878 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-052f29d3-941c-4d25-8f56-4b089c5e810e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:34.499497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-052f29d3-941c-4d25-8f56-4b089c5e810e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:34.519877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-052f29d3-941c-4d25-8f56-4b089c5e810e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1238 microversion: 2.1 time: 0.181436 Sep 09 21:25:34.521886 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 19/34] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:34 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1238 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:25:34.527882 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a8b379df-e501-4fd8-ac43-2f7d65630dd2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:34.535395 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a8b379df-e501-4fd8-ac43-2f7d65630dd2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:34.657950 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a8b379df-e501-4fd8-ac43-2f7d65630dd2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:34.669154 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a8b379df-e501-4fd8-ac43-2f7d65630dd2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:34.680418 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a8b379df-e501-4fd8-ac43-2f7d65630dd2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:34.680418 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a8b379df-e501-4fd8-ac43-2f7d65630dd2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1282 microversion: 2.20 time: 0.155334 Sep 09 21:25:34.698422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 20/35] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:34 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:35.553192 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-34d0605c-76a2-4575-ae8b-a559555173c9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:35.554512 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-34d0605c-76a2-4575-ae8b-a559555173c9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:35.567731 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-34d0605c-76a2-4575-ae8b-a559555173c9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:35.569162 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-34d0605c-76a2-4575-ae8b-a559555173c9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:35.570807 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-34d0605c-76a2-4575-ae8b-a559555173c9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:35.571583 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-34d0605c-76a2-4575-ae8b-a559555173c9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:35.572066 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-34d0605c-76a2-4575-ae8b-a559555173c9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:35.575663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-34d0605c-76a2-4575-ae8b-a559555173c9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:35.774632 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-34d0605c-76a2-4575-ae8b-a559555173c9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:35.787759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-34d0605c-76a2-4575-ae8b-a559555173c9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.240040 Sep 09 21:25:35.789798 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 21/36] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:35 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:25:35.795566 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:35.796769 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:35.804084 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:35.804832 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:35.808357 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:35.809573 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:35.811629 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:35.812240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:35.932314 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2863f7dc-ba28-4de2-95da-42696a7386e5 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:35.963057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2863f7dc-ba28-4de2-95da-42696a7386e5 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 1.692620 Sep 09 21:25:35.966482 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:35.973919 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 16/37] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:34 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:35.989606 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:35.991082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:35.992337 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c71a9fc8-a9f2-44e8-8085-354413aa4f89 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.201570 Sep 09 21:25:36.004494 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 22/38] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:35 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:36.783252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-b8a7dfcb-6a92-4755-a3e5-6bbfb41712e5 req-55ecb58a-96e5-40d8-8196-c40b8d28fb40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b02a0c-2af0-4acc-b06a-4b0cc6fc168d", "tag": "881bfd68-38cc-4849-929e-a49f51999764"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:36.797271 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8a7dfcb-6a92-4755-a3e5-6bbfb41712e5 req-55ecb58a-96e5-40d8-8196-c40b8d28fb40 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:36.797757 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8a7dfcb-6a92-4755-a3e5-6bbfb41712e5 req-55ecb58a-96e5-40d8-8196-c40b8d28fb40 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:36.798195 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8a7dfcb-6a92-4755-a3e5-6bbfb41712e5 req-55ecb58a-96e5-40d8-8196-c40b8d28fb40 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:36.812813 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-22c07bef-aa78-41ff-879a-253189701b52 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:36.813577 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-22c07bef-aa78-41ff-879a-253189701b52 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:36.820126 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-b8a7dfcb-6a92-4755-a3e5-6bbfb41712e5 req-55ecb58a-96e5-40d8-8196-c40b8d28fb40 service nova] Creating event network-changed:881bfd68-38cc-4849-929e-a49f51999764 for instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d on hv-cinder-85221 Sep 09 21:25:36.820579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22c07bef-aa78-41ff-879a-253189701b52 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:36.820726 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8a7dfcb-6a92-4755-a3e5-6bbfb41712e5 req-55ecb58a-96e5-40d8-8196-c40b8d28fb40 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 21:25:36.821044 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8a7dfcb-6a92-4755-a3e5-6bbfb41712e5 req-55ecb58a-96e5-40d8-8196-c40b8d28fb40 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 21:25:36.821276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22c07bef-aa78-41ff-879a-253189701b52 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:36.821927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22c07bef-aa78-41ff-879a-253189701b52 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:36.822064 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e2f718a-0276-4a78-9eb0-6e05e6ddf200 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:36.822512 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e2f718a-0276-4a78-9eb0-6e05e6ddf200 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:36.822771 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22c07bef-aa78-41ff-879a-253189701b52 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:36.823236 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e2f718a-0276-4a78-9eb0-6e05e6ddf200 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:36.823336 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22c07bef-aa78-41ff-879a-253189701b52 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:36.823774 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22c07bef-aa78-41ff-879a-253189701b52 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:36.823984 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e2f718a-0276-4a78-9eb0-6e05e6ddf200 None None] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:36.824442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e2f718a-0276-4a78-9eb0-6e05e6ddf200 None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:36.825059 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e2f718a-0276-4a78-9eb0-6e05e6ddf200 None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:36.836385 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.compute.rpcapi [None req-3e2f718a-0276-4a78-9eb0-6e05e6ddf200 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 21:25:36.837271 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e2f718a-0276-4a78-9eb0-6e05e6ddf200 None None] Releasing lock "compute-rpcapi-router" {{(pid=120466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 21:25:36.853037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3e2f718a-0276-4a78-9eb0-6e05e6ddf200 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126473 Sep 09 21:25:36.854197 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 17/39] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:25:36.892178 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-22c07bef-aa78-41ff-879a-253189701b52 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:36.900460 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-22c07bef-aa78-41ff-879a-253189701b52 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.091650 Sep 09 21:25:36.901080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 23/40] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:36 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:36.994573 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-edcad17c-f4e0-428f-8f46-8833f99a0a46 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:36.995378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-edcad17c-f4e0-428f-8f46-8833f99a0a46 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:37.001815 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edcad17c-f4e0-428f-8f46-8833f99a0a46 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:37.002303 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edcad17c-f4e0-428f-8f46-8833f99a0a46 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:37.002743 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edcad17c-f4e0-428f-8f46-8833f99a0a46 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:37.003427 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edcad17c-f4e0-428f-8f46-8833f99a0a46 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:37.003924 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edcad17c-f4e0-428f-8f46-8833f99a0a46 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:37.004349 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edcad17c-f4e0-428f-8f46-8833f99a0a46 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:37.018250 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:37.018859 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:37.024972 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:37.026009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:37.026532 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:37.027330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:37.028263 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:37.029356 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:37.101903 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:37.111683 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:37.113490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:37.114793 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6b84fcdd-2557-4298-a37d-f09bc9efa2af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.100611 Sep 09 21:25:37.115484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 24/41] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:37 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:25:37.161769 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-edcad17c-f4e0-428f-8f46-8833f99a0a46 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:37.170051 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-edcad17c-f4e0-428f-8f46-8833f99a0a46 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.179594 Sep 09 21:25:37.172021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 18/42] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:36 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:37.926198 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-cbbeb26c-833b-44cc-aafd-4189ef0bbc40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:37.927492 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-cbbeb26c-833b-44cc-aafd-4189ef0bbc40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:37.933450 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cbbeb26c-833b-44cc-aafd-4189ef0bbc40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:37.933944 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cbbeb26c-833b-44cc-aafd-4189ef0bbc40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:37.934391 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cbbeb26c-833b-44cc-aafd-4189ef0bbc40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:37.935092 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cbbeb26c-833b-44cc-aafd-4189ef0bbc40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:37.935665 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cbbeb26c-833b-44cc-aafd-4189ef0bbc40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:37.936135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cbbeb26c-833b-44cc-aafd-4189ef0bbc40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:38.009443 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-cbbeb26c-833b-44cc-aafd-4189ef0bbc40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:38.028011 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-cbbeb26c-833b-44cc-aafd-4189ef0bbc40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.105545 Sep 09 21:25:38.028543 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 25/43] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:37 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:38.142401 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:38.143019 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:38.149749 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:38.150231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:38.150842 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:38.151664 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:38.151998 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:38.152425 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:38.195267 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-35efc8d5-24c0-42d2-90de-cdab7cdf7368 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:38.196073 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-35efc8d5-24c0-42d2-90de-cdab7cdf7368 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:38.202114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35efc8d5-24c0-42d2-90de-cdab7cdf7368 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:38.202690 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35efc8d5-24c0-42d2-90de-cdab7cdf7368 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:38.203204 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35efc8d5-24c0-42d2-90de-cdab7cdf7368 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:38.204146 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35efc8d5-24c0-42d2-90de-cdab7cdf7368 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:38.204828 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35efc8d5-24c0-42d2-90de-cdab7cdf7368 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:38.205469 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35efc8d5-24c0-42d2-90de-cdab7cdf7368 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:38.224016 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:38.233053 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:38.234554 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:38.235930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-340649e4-bd0b-4849-a376-c15533274d36 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.098466 Sep 09 21:25:38.252197 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 19/44] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:38 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:38.350857 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-35efc8d5-24c0-42d2-90de-cdab7cdf7368 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:38.359169 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-35efc8d5-24c0-42d2-90de-cdab7cdf7368 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.169462 Sep 09 21:25:38.359742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 26/45] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:38 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:25:39.053343 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a5d8aae3-52fd-42cc-ae7e-200735105ba7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:39.054496 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a5d8aae3-52fd-42cc-ae7e-200735105ba7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:39.061304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5d8aae3-52fd-42cc-ae7e-200735105ba7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:39.061804 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5d8aae3-52fd-42cc-ae7e-200735105ba7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:39.062245 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5d8aae3-52fd-42cc-ae7e-200735105ba7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:39.064392 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5d8aae3-52fd-42cc-ae7e-200735105ba7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:39.064958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5d8aae3-52fd-42cc-ae7e-200735105ba7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:39.065482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5d8aae3-52fd-42cc-ae7e-200735105ba7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:39.158078 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a5d8aae3-52fd-42cc-ae7e-200735105ba7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:39.167208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a5d8aae3-52fd-42cc-ae7e-200735105ba7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.119543 Sep 09 21:25:39.167832 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 20/46] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:39 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:39.262898 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:39.263842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:39.270515 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:39.274649 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:39.275425 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:39.277514 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:39.278625 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:39.279764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:39.347004 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:39.359871 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:39.361484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:39.362613 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-82d4ea84-9c97-4990-9cf7-e16f649b4381 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.104117 Sep 09 21:25:39.363169 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 27/47] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:39 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:39.382551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0bf27988-4ce6-493c-90d1-6521b5564e51 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:39.383199 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0bf27988-4ce6-493c-90d1-6521b5564e51 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:39.389921 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0bf27988-4ce6-493c-90d1-6521b5564e51 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:39.390419 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0bf27988-4ce6-493c-90d1-6521b5564e51 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:39.390864 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0bf27988-4ce6-493c-90d1-6521b5564e51 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:39.391757 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0bf27988-4ce6-493c-90d1-6521b5564e51 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:39.392233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0bf27988-4ce6-493c-90d1-6521b5564e51 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:39.393324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0bf27988-4ce6-493c-90d1-6521b5564e51 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:39.537310 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0bf27988-4ce6-493c-90d1-6521b5564e51 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:39.545771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0bf27988-4ce6-493c-90d1-6521b5564e51 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.167161 Sep 09 21:25:39.546331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 21/48] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:39 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:40.190106 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4da93560-665a-469c-a522-587ff9c9acbe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:40.190727 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4da93560-665a-469c-a522-587ff9c9acbe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:40.197465 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4da93560-665a-469c-a522-587ff9c9acbe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:40.197967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4da93560-665a-469c-a522-587ff9c9acbe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:40.198426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4da93560-665a-469c-a522-587ff9c9acbe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:40.199125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4da93560-665a-469c-a522-587ff9c9acbe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:40.199712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4da93560-665a-469c-a522-587ff9c9acbe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:40.200239 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4da93560-665a-469c-a522-587ff9c9acbe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:40.268347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4da93560-665a-469c-a522-587ff9c9acbe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:40.277808 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4da93560-665a-469c-a522-587ff9c9acbe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.091438 Sep 09 21:25:40.278599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 28/49] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:40 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:40.390590 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:40.392128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:40.406084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:40.408027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:40.409253 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:40.412324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:40.415120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:40.417026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:40.546673 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:40.558738 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:40.560470 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:40.561807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e604cd29-26f8-4cb7-870e-624ebf20e22b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.175831 Sep 09 21:25:40.563023 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 22/50] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:40 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:40.580880 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-aa146b38-f942-4a26-9649-4451902a376b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:40.581493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-aa146b38-f942-4a26-9649-4451902a376b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:40.591847 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aa146b38-f942-4a26-9649-4451902a376b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:40.592304 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aa146b38-f942-4a26-9649-4451902a376b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:40.592750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aa146b38-f942-4a26-9649-4451902a376b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:40.593476 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aa146b38-f942-4a26-9649-4451902a376b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:40.593922 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aa146b38-f942-4a26-9649-4451902a376b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:40.594349 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aa146b38-f942-4a26-9649-4451902a376b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:40.779097 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-aa146b38-f942-4a26-9649-4451902a376b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:40.803958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-aa146b38-f942-4a26-9649-4451902a376b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.226629 Sep 09 21:25:40.805168 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 29/51] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:40 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:41.305725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8ae409c0-5eb0-4fa5-a662-198fae6e2e7c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:41.307038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8ae409c0-5eb0-4fa5-a662-198fae6e2e7c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:41.327309 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ae409c0-5eb0-4fa5-a662-198fae6e2e7c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:41.328340 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ae409c0-5eb0-4fa5-a662-198fae6e2e7c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:41.328845 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ae409c0-5eb0-4fa5-a662-198fae6e2e7c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:41.329583 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ae409c0-5eb0-4fa5-a662-198fae6e2e7c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:41.330313 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ae409c0-5eb0-4fa5-a662-198fae6e2e7c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:41.330935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ae409c0-5eb0-4fa5-a662-198fae6e2e7c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:41.429201 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8ae409c0-5eb0-4fa5-a662-198fae6e2e7c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:41.438077 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8ae409c0-5eb0-4fa5-a662-198fae6e2e7c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.139341 Sep 09 21:25:41.439037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 23/52] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:41 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:41.612310 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:41.613380 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:41.622348 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:41.623730 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:41.624623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:41.625507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:41.630889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:41.631647 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:41.766736 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:41.789886 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:41.802080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:41.808362 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-572ec964-a4d2-45e6-97ad-b57e8073e20a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.221524 Sep 09 21:25:41.825415 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 30/53] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:41 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:41.827234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5fb1b5bb-cbb0-4bdd-8535-dfb65a3a6bea tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:41.828106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5fb1b5bb-cbb0-4bdd-8535-dfb65a3a6bea tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:41.839365 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fb1b5bb-cbb0-4bdd-8535-dfb65a3a6bea tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:41.840906 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fb1b5bb-cbb0-4bdd-8535-dfb65a3a6bea tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:41.841743 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fb1b5bb-cbb0-4bdd-8535-dfb65a3a6bea tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:41.842627 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fb1b5bb-cbb0-4bdd-8535-dfb65a3a6bea tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:41.843279 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fb1b5bb-cbb0-4bdd-8535-dfb65a3a6bea tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:41.843889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fb1b5bb-cbb0-4bdd-8535-dfb65a3a6bea tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:42.173990 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5fb1b5bb-cbb0-4bdd-8535-dfb65a3a6bea tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:42.184000 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5fb1b5bb-cbb0-4bdd-8535-dfb65a3a6bea tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.360737 Sep 09 21:25:42.187899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 24/54] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:41 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:42.464521 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c1347a83-963e-437d-96a5-2be3b8f9917a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:42.465403 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c1347a83-963e-437d-96a5-2be3b8f9917a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:42.474381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1347a83-963e-437d-96a5-2be3b8f9917a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:42.475225 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1347a83-963e-437d-96a5-2be3b8f9917a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:42.475857 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1347a83-963e-437d-96a5-2be3b8f9917a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:42.476726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1347a83-963e-437d-96a5-2be3b8f9917a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:42.477654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1347a83-963e-437d-96a5-2be3b8f9917a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:42.478488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1347a83-963e-437d-96a5-2be3b8f9917a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:42.479214 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:42.570277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c1347a83-963e-437d-96a5-2be3b8f9917a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:42.580208 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c1347a83-963e-437d-96a5-2be3b8f9917a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.120378 Sep 09 21:25:42.581540 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 31/55] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:42 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:42.837467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:42.838111 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:42.844015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:42.844497 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:42.844958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:42.845670 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:42.846127 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:42.846553 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:42.913612 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:42.922027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:42.923477 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:42.924614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-30b3b931-fffb-4083-a246-cec296ecd8b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.091171 Sep 09 21:25:42.925155 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 25/56] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:42 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:43.217125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-974396ad-9581-40b8-9c24-af6512f2b36b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:43.218009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-974396ad-9581-40b8-9c24-af6512f2b36b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:43.224483 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-974396ad-9581-40b8-9c24-af6512f2b36b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:43.225064 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-974396ad-9581-40b8-9c24-af6512f2b36b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:43.225570 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-974396ad-9581-40b8-9c24-af6512f2b36b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:43.226439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-974396ad-9581-40b8-9c24-af6512f2b36b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:43.226939 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-974396ad-9581-40b8-9c24-af6512f2b36b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:43.227365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-974396ad-9581-40b8-9c24-af6512f2b36b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:43.390631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-974396ad-9581-40b8-9c24-af6512f2b36b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:43.402785 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-974396ad-9581-40b8-9c24-af6512f2b36b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.189810 Sep 09 21:25:43.403387 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 32/57] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:43 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:43.605552 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1d38f83a-e419-470e-bac7-93e51e6fc6f4 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:43.606319 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1d38f83a-e419-470e-bac7-93e51e6fc6f4 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:43.610383 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=16 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:43.616183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38f83a-e419-470e-bac7-93e51e6fc6f4 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:43.616679 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38f83a-e419-470e-bac7-93e51e6fc6f4 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:43.617120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38f83a-e419-470e-bac7-93e51e6fc6f4 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:43.617847 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38f83a-e419-470e-bac7-93e51e6fc6f4 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:43.618308 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38f83a-e419-470e-bac7-93e51e6fc6f4 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:43.618736 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38f83a-e419-470e-bac7-93e51e6fc6f4 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:43.687161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1d38f83a-e419-470e-bac7-93e51e6fc6f4 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:43.695351 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1d38f83a-e419-470e-bac7-93e51e6fc6f4 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.094666 Sep 09 21:25:43.695944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 26/58] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:43 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:43.950568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:43.951209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:43.957056 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:43.958264 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:43.958716 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:43.959397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:43.959883 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:43.960312 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:44.019190 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:44.027899 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:44.029352 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:44.030443 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2ee0b506-0a79-4fa2-a657-d89fa63ae8e8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.083708 Sep 09 21:25:44.030988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 33/59] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:43 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:44.426016 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d768b549-e6cc-42f3-9c2f-d54d230ace63 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:44.426789 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d768b549-e6cc-42f3-9c2f-d54d230ace63 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:44.432616 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d768b549-e6cc-42f3-9c2f-d54d230ace63 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:44.433098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d768b549-e6cc-42f3-9c2f-d54d230ace63 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:44.433532 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d768b549-e6cc-42f3-9c2f-d54d230ace63 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:44.434207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d768b549-e6cc-42f3-9c2f-d54d230ace63 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:44.434663 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d768b549-e6cc-42f3-9c2f-d54d230ace63 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:44.435081 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d768b549-e6cc-42f3-9c2f-d54d230ace63 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:44.572371 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d768b549-e6cc-42f3-9c2f-d54d230ace63 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:44.579856 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d768b549-e6cc-42f3-9c2f-d54d230ace63 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.157632 Sep 09 21:25:44.580435 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 27/60] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:44 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:44.722456 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-24d8c6f9-55ae-4383-abc6-50dc2cd22e13 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:44.723656 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-24d8c6f9-55ae-4383-abc6-50dc2cd22e13 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:44.725603 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=22 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:44.730986 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d8c6f9-55ae-4383-abc6-50dc2cd22e13 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:44.731467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d8c6f9-55ae-4383-abc6-50dc2cd22e13 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:44.731925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d8c6f9-55ae-4383-abc6-50dc2cd22e13 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:44.732605 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d8c6f9-55ae-4383-abc6-50dc2cd22e13 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:44.733083 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d8c6f9-55ae-4383-abc6-50dc2cd22e13 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:44.733499 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d8c6f9-55ae-4383-abc6-50dc2cd22e13 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:44.802666 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-24d8c6f9-55ae-4383-abc6-50dc2cd22e13 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:44.810709 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-24d8c6f9-55ae-4383-abc6-50dc2cd22e13 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.096339 Sep 09 21:25:44.811270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 34/61] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:44 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:45.056615 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:45.057230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:45.063099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:45.063615 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:45.064057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:45.064740 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:45.065196 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:45.065623 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:45.126657 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:45.135382 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:45.136863 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:45.139080 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-96a6f142-70da-44b8-8d56-994f8423b392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.087388 Sep 09 21:25:45.139714 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 28/62] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:45 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:45.604220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-818d1d39-9560-4f75-8c64-767c176706cd tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:45.604829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-818d1d39-9560-4f75-8c64-767c176706cd tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:45.610702 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-818d1d39-9560-4f75-8c64-767c176706cd tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:45.611180 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-818d1d39-9560-4f75-8c64-767c176706cd tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:45.611639 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-818d1d39-9560-4f75-8c64-767c176706cd tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:45.612320 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-818d1d39-9560-4f75-8c64-767c176706cd tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:45.612773 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-818d1d39-9560-4f75-8c64-767c176706cd tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:45.613196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-818d1d39-9560-4f75-8c64-767c176706cd tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:45.618095 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=100 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:45.746386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-818d1d39-9560-4f75-8c64-767c176706cd tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:45.753981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-818d1d39-9560-4f75-8c64-767c176706cd tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.153815 Sep 09 21:25:45.754582 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 35/63] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:45 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:45.834037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8acaffaa-33bb-45c7-958e-3809821f0335 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:45.834642 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8acaffaa-33bb-45c7-958e-3809821f0335 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:45.840542 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8acaffaa-33bb-45c7-958e-3809821f0335 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:45.841023 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8acaffaa-33bb-45c7-958e-3809821f0335 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:45.841459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8acaffaa-33bb-45c7-958e-3809821f0335 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:45.842135 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8acaffaa-33bb-45c7-958e-3809821f0335 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:45.842586 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8acaffaa-33bb-45c7-958e-3809821f0335 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:45.843006 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8acaffaa-33bb-45c7-958e-3809821f0335 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:45.846988 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=100 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:45.904441 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8acaffaa-33bb-45c7-958e-3809821f0335 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:45.912364 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8acaffaa-33bb-45c7-958e-3809821f0335 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.082216 Sep 09 21:25:45.912917 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 29/64] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:45 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:46.165329 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:46.165931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:46.171929 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:46.172408 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:46.172833 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:46.173534 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:46.173984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:46.174406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:46.234262 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:46.242977 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:46.244384 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:46.245463 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f03b6028-00d5-48e1-8c59-2ab40c320eb0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.084681 Sep 09 21:25:46.246022 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 36/65] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:46 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:46.776557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ac1c3182-28ac-424b-8eb5-4a1535e54ddf tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:46.777213 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ac1c3182-28ac-424b-8eb5-4a1535e54ddf tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:46.783081 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac1c3182-28ac-424b-8eb5-4a1535e54ddf tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:46.783594 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac1c3182-28ac-424b-8eb5-4a1535e54ddf tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:46.784288 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac1c3182-28ac-424b-8eb5-4a1535e54ddf tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:46.785005 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac1c3182-28ac-424b-8eb5-4a1535e54ddf tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:46.785969 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac1c3182-28ac-424b-8eb5-4a1535e54ddf tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:46.786430 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac1c3182-28ac-424b-8eb5-4a1535e54ddf tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:46.832053 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=4 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:46.920697 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ac1c3182-28ac-424b-8eb5-4a1535e54ddf tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:46.928817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ac1c3182-28ac-424b-8eb5-4a1535e54ddf tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.156149 Sep 09 21:25:46.929378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 30/66] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:46 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:46.935615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a41ae613-706b-4cae-acf8-e3e2a184e1b1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:46.936220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a41ae613-706b-4cae-acf8-e3e2a184e1b1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:46.942958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a41ae613-706b-4cae-acf8-e3e2a184e1b1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:46.943558 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a41ae613-706b-4cae-acf8-e3e2a184e1b1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:46.944000 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a41ae613-706b-4cae-acf8-e3e2a184e1b1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:46.944680 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a41ae613-706b-4cae-acf8-e3e2a184e1b1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:46.945130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a41ae613-706b-4cae-acf8-e3e2a184e1b1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:46.945549 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a41ae613-706b-4cae-acf8-e3e2a184e1b1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:47.006279 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a41ae613-706b-4cae-acf8-e3e2a184e1b1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:47.013657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a41ae613-706b-4cae-acf8-e3e2a184e1b1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1290 microversion: 2.1 time: 0.081862 Sep 09 21:25:47.014209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 37/67] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:46 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:47.271041 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:47.271813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:47.278272 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:47.278760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:47.279352 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:47.280250 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:47.280716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:47.281141 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:47.383324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:47.391391 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:47.392879 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:47.393985 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1ee4c50b-550c-42ad-936c-1f7ded374e71 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1278 microversion: 2.20 time: 0.127561 Sep 09 21:25:47.394538 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 31/68] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:47 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:25:47.952056 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0a44d02f-332a-4f5b-9681-ac3692112c82 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:47.953377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0a44d02f-332a-4f5b-9681-ac3692112c82 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:47.959700 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a44d02f-332a-4f5b-9681-ac3692112c82 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:47.960589 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a44d02f-332a-4f5b-9681-ac3692112c82 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:47.961238 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a44d02f-332a-4f5b-9681-ac3692112c82 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:47.962227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a44d02f-332a-4f5b-9681-ac3692112c82 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:47.962894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a44d02f-332a-4f5b-9681-ac3692112c82 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:47.963519 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a44d02f-332a-4f5b-9681-ac3692112c82 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:48.041772 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c40644eb-5f2f-4eb1-ae22-976263b933e8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:48.044047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c40644eb-5f2f-4eb1-ae22-976263b933e8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:48.058562 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c40644eb-5f2f-4eb1-ae22-976263b933e8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:48.059627 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c40644eb-5f2f-4eb1-ae22-976263b933e8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:48.060516 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c40644eb-5f2f-4eb1-ae22-976263b933e8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:48.061404 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c40644eb-5f2f-4eb1-ae22-976263b933e8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:48.062375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c40644eb-5f2f-4eb1-ae22-976263b933e8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:48.063090 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c40644eb-5f2f-4eb1-ae22-976263b933e8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:48.170966 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0a44d02f-332a-4f5b-9681-ac3692112c82 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:48.180877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0a44d02f-332a-4f5b-9681-ac3692112c82 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.232587 Sep 09 21:25:48.196323 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 38/69] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:47 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:48.212685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c40644eb-5f2f-4eb1-ae22-976263b933e8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:48.222555 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c40644eb-5f2f-4eb1-ae22-976263b933e8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1308 microversion: 2.1 time: 0.188612 Sep 09 21:25:48.236985 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 32/70] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:48 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1308 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:25:48.422714 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:48.423339 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:48.436808 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:48.439070 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:48.440180 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:48.444123 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:48.445129 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:48.445678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:48.446192 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:48.516180 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:48.524935 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:48.526534 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:48.528967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9ae37eb4-e7f3-453a-ae42-47d05ca58bf1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1334 microversion: 2.20 time: 0.110220 Sep 09 21:25:48.529525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 39/71] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:48 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1334 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:49.210324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-52bd91e4-fa69-4846-8a05-b8871d2d3044 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:49.210958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-52bd91e4-fa69-4846-8a05-b8871d2d3044 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:49.218436 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:49.221008 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52bd91e4-fa69-4846-8a05-b8871d2d3044 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:49.221509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52bd91e4-fa69-4846-8a05-b8871d2d3044 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:49.222037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52bd91e4-fa69-4846-8a05-b8871d2d3044 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:49.223079 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52bd91e4-fa69-4846-8a05-b8871d2d3044 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:49.223920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52bd91e4-fa69-4846-8a05-b8871d2d3044 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:49.224592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52bd91e4-fa69-4846-8a05-b8871d2d3044 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:49.251859 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-52a972d5-a559-49cc-92e7-4c2302ba8b36 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:49.253746 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-52a972d5-a559-49cc-92e7-4c2302ba8b36 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:49.271517 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a972d5-a559-49cc-92e7-4c2302ba8b36 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:49.272320 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a972d5-a559-49cc-92e7-4c2302ba8b36 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:49.272919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a972d5-a559-49cc-92e7-4c2302ba8b36 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:49.273777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a972d5-a559-49cc-92e7-4c2302ba8b36 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:49.275130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a972d5-a559-49cc-92e7-4c2302ba8b36 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:49.275765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a972d5-a559-49cc-92e7-4c2302ba8b36 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:49.373611 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-52a972d5-a559-49cc-92e7-4c2302ba8b36 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:49.387677 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-52a972d5-a559-49cc-92e7-4c2302ba8b36 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1296 microversion: 2.1 time: 0.140199 Sep 09 21:25:49.388936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 40/72] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:49 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1296 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:25:49.555468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-52bd91e4-fa69-4846-8a05-b8871d2d3044 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:49.565730 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:49.568043 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-52bd91e4-fa69-4846-8a05-b8871d2d3044 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.361304 Sep 09 21:25:49.569455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:49.580089 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:49.580981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:49.581588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:49.583347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:49.584654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:49.585234 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:49.586093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 33/73] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:49 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:49.767970 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:49.781799 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:49.784720 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:49.786398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-35dabdd7-24c5-402d-b2bf-ba70150e8512 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1340 microversion: 2.20 time: 0.229174 Sep 09 21:25:49.787046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 41/74] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:49 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1340 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:50.412705 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2eaec488-ab1c-4dae-b3ad-48db135eb71b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:50.413253 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2eaec488-ab1c-4dae-b3ad-48db135eb71b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:50.419136 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2eaec488-ab1c-4dae-b3ad-48db135eb71b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:50.419657 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2eaec488-ab1c-4dae-b3ad-48db135eb71b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:50.420093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2eaec488-ab1c-4dae-b3ad-48db135eb71b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:50.420773 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2eaec488-ab1c-4dae-b3ad-48db135eb71b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:50.421261 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2eaec488-ab1c-4dae-b3ad-48db135eb71b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:50.421686 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2eaec488-ab1c-4dae-b3ad-48db135eb71b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:50.552472 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2eaec488-ab1c-4dae-b3ad-48db135eb71b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:50.559942 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2eaec488-ab1c-4dae-b3ad-48db135eb71b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.151376 Sep 09 21:25:50.560500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 34/75] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:50 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:50.592984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7c8275b7-8080-4be0-9332-730adabf9969 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:50.593628 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7c8275b7-8080-4be0-9332-730adabf9969 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:50.600585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c8275b7-8080-4be0-9332-730adabf9969 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:50.601061 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c8275b7-8080-4be0-9332-730adabf9969 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:50.601491 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c8275b7-8080-4be0-9332-730adabf9969 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:50.602162 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c8275b7-8080-4be0-9332-730adabf9969 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:50.602616 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c8275b7-8080-4be0-9332-730adabf9969 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:50.603029 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c8275b7-8080-4be0-9332-730adabf9969 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:50.730465 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7c8275b7-8080-4be0-9332-730adabf9969 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:50.738030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7c8275b7-8080-4be0-9332-730adabf9969 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.149147 Sep 09 21:25:50.739157 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 42/76] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:50 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:50.814109 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:50.814796 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:50.822566 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:50.822566 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:50.823338 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:50.824659 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:50.825132 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:50.825565 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:50.958295 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:50.966330 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:50.967790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:50.968890 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8120c0cf-a05c-436c-9f25-ec67637f3389 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.158730 Sep 09 21:25:50.969422 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 35/77] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:50 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:51.583194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6a1bbc3a-6dfb-4de7-9832-c62f37586b76 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:51.583931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6a1bbc3a-6dfb-4de7-9832-c62f37586b76 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:51.589898 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6a1bbc3a-6dfb-4de7-9832-c62f37586b76 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:51.590376 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6a1bbc3a-6dfb-4de7-9832-c62f37586b76 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:51.590808 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6a1bbc3a-6dfb-4de7-9832-c62f37586b76 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:51.591485 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6a1bbc3a-6dfb-4de7-9832-c62f37586b76 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:51.591957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6a1bbc3a-6dfb-4de7-9832-c62f37586b76 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:51.592377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6a1bbc3a-6dfb-4de7-9832-c62f37586b76 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:51.725269 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6a1bbc3a-6dfb-4de7-9832-c62f37586b76 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:51.732808 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6a1bbc3a-6dfb-4de7-9832-c62f37586b76 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.154216 Sep 09 21:25:51.733362 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 43/78] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:51 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:51.760707 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a4ac338d-c755-4776-8dea-a4d32cf74df4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:51.761325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a4ac338d-c755-4776-8dea-a4d32cf74df4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:51.767305 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4ac338d-c755-4776-8dea-a4d32cf74df4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:51.767827 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4ac338d-c755-4776-8dea-a4d32cf74df4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:51.768271 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4ac338d-c755-4776-8dea-a4d32cf74df4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:51.768954 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4ac338d-c755-4776-8dea-a4d32cf74df4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:51.769416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4ac338d-c755-4776-8dea-a4d32cf74df4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:51.770445 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4ac338d-c755-4776-8dea-a4d32cf74df4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:51.901902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a4ac338d-c755-4776-8dea-a4d32cf74df4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:51.910340 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a4ac338d-c755-4776-8dea-a4d32cf74df4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.153494 Sep 09 21:25:51.911769 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 36/79] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:51 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:51.994356 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:51.994953 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:52.001131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:52.001611 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:52.002040 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:52.002715 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:52.003176 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:52.003611 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:52.134759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:52.142983 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:52.144435 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:52.146151 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d1f3c49e-0cf9-4dee-b01f-20bbd810be8b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.155308 Sep 09 21:25:52.146695 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 44/80] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:51 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:52.756579 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e10978c4-f67e-4825-92f6-1a8868b5bc48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:52.757183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e10978c4-f67e-4825-92f6-1a8868b5bc48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:52.763082 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e10978c4-f67e-4825-92f6-1a8868b5bc48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:52.763658 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e10978c4-f67e-4825-92f6-1a8868b5bc48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:52.764010 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e10978c4-f67e-4825-92f6-1a8868b5bc48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:52.764682 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e10978c4-f67e-4825-92f6-1a8868b5bc48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:52.765133 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e10978c4-f67e-4825-92f6-1a8868b5bc48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:52.765549 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e10978c4-f67e-4825-92f6-1a8868b5bc48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:52.892615 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e10978c4-f67e-4825-92f6-1a8868b5bc48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:52.900666 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e10978c4-f67e-4825-92f6-1a8868b5bc48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.148599 Sep 09 21:25:52.901225 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 37/81] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:52 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:52.933904 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9cefb55a-75e4-4779-872e-54fbca0bf1bc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:52.934523 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9cefb55a-75e4-4779-872e-54fbca0bf1bc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:52.940893 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9cefb55a-75e4-4779-872e-54fbca0bf1bc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:52.941382 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9cefb55a-75e4-4779-872e-54fbca0bf1bc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:52.941879 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9cefb55a-75e4-4779-872e-54fbca0bf1bc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:52.942593 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9cefb55a-75e4-4779-872e-54fbca0bf1bc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:52.943029 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9cefb55a-75e4-4779-872e-54fbca0bf1bc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:52.943507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9cefb55a-75e4-4779-872e-54fbca0bf1bc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:53.071685 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9cefb55a-75e4-4779-872e-54fbca0bf1bc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:53.079261 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9cefb55a-75e4-4779-872e-54fbca0bf1bc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.149167 Sep 09 21:25:53.079847 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 45/82] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:52 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:53.172806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:53.173416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:53.179877 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:53.180360 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:53.180790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:53.181464 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:53.181915 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:53.182332 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:53.374218 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:53.383924 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:53.385426 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:53.386681 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-11cf6201-b628-4531-8ac5-b3e6bc1eaf34 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.217543 Sep 09 21:25:53.387899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 38/83] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:53 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:53.924516 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-916b8382-44e8-4a7e-9a3a-6c772efab22b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:53.925361 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-916b8382-44e8-4a7e-9a3a-6c772efab22b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:53.932396 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b8382-44e8-4a7e-9a3a-6c772efab22b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:53.932879 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b8382-44e8-4a7e-9a3a-6c772efab22b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:53.933471 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b8382-44e8-4a7e-9a3a-6c772efab22b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:53.934371 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b8382-44e8-4a7e-9a3a-6c772efab22b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:53.935068 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b8382-44e8-4a7e-9a3a-6c772efab22b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:53.935751 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b8382-44e8-4a7e-9a3a-6c772efab22b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:53.983778 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-7137b0e9-9192-4d93-8e37-9ca5d76b4ab2 req-618f75ab-1300-4e15-aeb2-f6a7ea896623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb8f74a7-256c-4810-944b-e4f66773aa13", "tag": "b28ee03c-d6a8-454c-b9c8-a9a10b589dbc"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:54.013828 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-7137b0e9-9192-4d93-8e37-9ca5d76b4ab2 req-618f75ab-1300-4e15-aeb2-f6a7ea896623 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:54.014412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-7137b0e9-9192-4d93-8e37-9ca5d76b4ab2 req-618f75ab-1300-4e15-aeb2-f6a7ea896623 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:54.014900 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-7137b0e9-9192-4d93-8e37-9ca5d76b4ab2 req-618f75ab-1300-4e15-aeb2-f6a7ea896623 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:54.033911 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-7137b0e9-9192-4d93-8e37-9ca5d76b4ab2 req-618f75ab-1300-4e15-aeb2-f6a7ea896623 service nova] Creating event network-changed:b28ee03c-d6a8-454c-b9c8-a9a10b589dbc for instance cb8f74a7-256c-4810-944b-e4f66773aa13 on hv-cinder-85221 Sep 09 21:25:54.043704 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-7137b0e9-9192-4d93-8e37-9ca5d76b4ab2 req-618f75ab-1300-4e15-aeb2-f6a7ea896623 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063273 Sep 09 21:25:54.045893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 39/84] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:25:54.104060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f6e5da30-746c-4d20-a422-c8a05c1498dc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:54.104755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f6e5da30-746c-4d20-a422-c8a05c1498dc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:54.123254 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f6e5da30-746c-4d20-a422-c8a05c1498dc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:54.124161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f6e5da30-746c-4d20-a422-c8a05c1498dc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:54.125009 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f6e5da30-746c-4d20-a422-c8a05c1498dc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:54.125806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f6e5da30-746c-4d20-a422-c8a05c1498dc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:54.127442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f6e5da30-746c-4d20-a422-c8a05c1498dc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:54.127590 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f6e5da30-746c-4d20-a422-c8a05c1498dc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:54.174590 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-916b8382-44e8-4a7e-9a3a-6c772efab22b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:54.183936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-916b8382-44e8-4a7e-9a3a-6c772efab22b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.263260 Sep 09 21:25:54.184812 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 46/85] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:53 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:54.319453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-4b2f736e-7668-4e76-a79d-90cb74c9be03 req-bd927610-8a90-4078-91f8-c75364ffa7ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27906035-8bb1-450e-bb91-c40551e1a437", "tag": "6bb94d88-fa7a-411f-a02b-1791dad73802"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:54.332287 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-4b2f736e-7668-4e76-a79d-90cb74c9be03 req-bd927610-8a90-4078-91f8-c75364ffa7ab service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:54.332919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-4b2f736e-7668-4e76-a79d-90cb74c9be03 req-bd927610-8a90-4078-91f8-c75364ffa7ab service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:54.333797 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-4b2f736e-7668-4e76-a79d-90cb74c9be03 req-bd927610-8a90-4078-91f8-c75364ffa7ab service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:54.346382 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f6e5da30-746c-4d20-a422-c8a05c1498dc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:54.355334 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f6e5da30-746c-4d20-a422-c8a05c1498dc tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.255220 Sep 09 21:25:54.356223 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 40/86] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:54 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:54.371557 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-4b2f736e-7668-4e76-a79d-90cb74c9be03 req-bd927610-8a90-4078-91f8-c75364ffa7ab service nova] Creating event network-changed:6bb94d88-fa7a-411f-a02b-1791dad73802 for instance 27906035-8bb1-450e-bb91-c40551e1a437 on hv-cinder-85221 Sep 09 21:25:54.372091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-4b2f736e-7668-4e76-a79d-90cb74c9be03 req-bd927610-8a90-4078-91f8-c75364ffa7ab service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120465) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 21:25:54.372477 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-4b2f736e-7668-4e76-a79d-90cb74c9be03 req-bd927610-8a90-4078-91f8-c75364ffa7ab service nova] Acquired lock "compute-rpcapi-router" {{(pid=120465) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 21:25:54.373677 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-118a8ff0-3c83-4424-968f-2d4859477946 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:54.374129 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-118a8ff0-3c83-4424-968f-2d4859477946 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:54.374720 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-118a8ff0-3c83-4424-968f-2d4859477946 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:54.375424 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-118a8ff0-3c83-4424-968f-2d4859477946 None None] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:54.375903 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-118a8ff0-3c83-4424-968f-2d4859477946 None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:54.376324 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-118a8ff0-3c83-4424-968f-2d4859477946 None None] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:54.386227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.compute.rpcapi [None req-118a8ff0-3c83-4424-968f-2d4859477946 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 21:25:54.387095 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-118a8ff0-3c83-4424-968f-2d4859477946 None None] Releasing lock "compute-rpcapi-router" {{(pid=120465) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 21:25:54.403985 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-118a8ff0-3c83-4424-968f-2d4859477946 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156371 Sep 09 21:25:54.404588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 47/87] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:25:54.414703 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:54.415445 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:54.424359 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:54.425483 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:54.428127 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:54.428846 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:54.429349 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:54.430215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:54.584829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:54.594069 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:54.595933 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:54.597340 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ac55b660-0b6a-4cb4-b93d-d4c797604f8d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.188288 Sep 09 21:25:54.598104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 41/88] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:54 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:55.207998 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0741978e-3728-408f-ae4c-2993685b27b0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:55.208621 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0741978e-3728-408f-ae4c-2993685b27b0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:55.215673 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0741978e-3728-408f-ae4c-2993685b27b0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:55.216237 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0741978e-3728-408f-ae4c-2993685b27b0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:55.216746 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0741978e-3728-408f-ae4c-2993685b27b0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:55.217548 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0741978e-3728-408f-ae4c-2993685b27b0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:55.218073 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0741978e-3728-408f-ae4c-2993685b27b0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:55.218965 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0741978e-3728-408f-ae4c-2993685b27b0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:55.356347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0741978e-3728-408f-ae4c-2993685b27b0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:55.364006 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0741978e-3728-408f-ae4c-2993685b27b0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.160418 Sep 09 21:25:55.365085 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 48/89] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:55 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:55.383756 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3a7b1e9f-9e6e-48af-9a6d-1645abf7ce90 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:55.384522 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3a7b1e9f-9e6e-48af-9a6d-1645abf7ce90 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:55.390401 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a7b1e9f-9e6e-48af-9a6d-1645abf7ce90 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:55.390962 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a7b1e9f-9e6e-48af-9a6d-1645abf7ce90 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:55.391478 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a7b1e9f-9e6e-48af-9a6d-1645abf7ce90 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:55.392228 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a7b1e9f-9e6e-48af-9a6d-1645abf7ce90 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:55.392743 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a7b1e9f-9e6e-48af-9a6d-1645abf7ce90 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:55.393145 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a7b1e9f-9e6e-48af-9a6d-1645abf7ce90 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:55.581415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-3a7b1e9f-9e6e-48af-9a6d-1645abf7ce90 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:55.589549 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3a7b1e9f-9e6e-48af-9a6d-1645abf7ce90 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.209710 Sep 09 21:25:55.590102 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 42/90] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:55 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:55.622263 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:55.622877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:55.628758 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:55.630097 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:55.630830 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:55.632164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:55.632804 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:55.633416 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:55.793009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:55.801139 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:55.802623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:55.803745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bd00e294-0886-4b6f-918a-6e4c810464f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.185435 Sep 09 21:25:55.804294 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 49/91] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:55 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:56.387326 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4d7d2430-d098-4449-a82d-5dd0bacc0e24 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:56.388038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4d7d2430-d098-4449-a82d-5dd0bacc0e24 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:56.393888 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d7d2430-d098-4449-a82d-5dd0bacc0e24 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:56.394374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d7d2430-d098-4449-a82d-5dd0bacc0e24 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:56.395382 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d7d2430-d098-4449-a82d-5dd0bacc0e24 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:56.396117 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d7d2430-d098-4449-a82d-5dd0bacc0e24 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:56.396580 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d7d2430-d098-4449-a82d-5dd0bacc0e24 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:56.397012 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d7d2430-d098-4449-a82d-5dd0bacc0e24 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:56.532957 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4d7d2430-d098-4449-a82d-5dd0bacc0e24 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:56.541446 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4d7d2430-d098-4449-a82d-5dd0bacc0e24 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.157943 Sep 09 21:25:56.542011 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 43/92] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:56 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:56.614664 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c2fdbba0-804f-4357-ab0e-e651329ad220 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:56.615314 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c2fdbba0-804f-4357-ab0e-e651329ad220 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:56.622800 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c2fdbba0-804f-4357-ab0e-e651329ad220 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:56.623624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c2fdbba0-804f-4357-ab0e-e651329ad220 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:56.624311 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c2fdbba0-804f-4357-ab0e-e651329ad220 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:56.625270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c2fdbba0-804f-4357-ab0e-e651329ad220 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:56.625903 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c2fdbba0-804f-4357-ab0e-e651329ad220 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:56.626405 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c2fdbba0-804f-4357-ab0e-e651329ad220 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:56.768826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c2fdbba0-804f-4357-ab0e-e651329ad220 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:56.778027 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c2fdbba0-804f-4357-ab0e-e651329ad220 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.169450 Sep 09 21:25:56.778688 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 50/93] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:56 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:56.829563 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:56.830232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:56.840819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:56.841314 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:56.841914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:56.842629 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:56.843083 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:56.843696 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:56.987084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:56.997759 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:56.997759 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:56.998330 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-15548ce9-d9c7-41ef-9276-98ce40ae5b0c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.172737 Sep 09 21:25:56.999141 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 44/94] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:56 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:57.570457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4554563a-d762-4ded-9ecd-a2cb3a80c806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:57.570457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4554563a-d762-4ded-9ecd-a2cb3a80c806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:57.573093 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4554563a-d762-4ded-9ecd-a2cb3a80c806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:57.573586 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4554563a-d762-4ded-9ecd-a2cb3a80c806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:57.574021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4554563a-d762-4ded-9ecd-a2cb3a80c806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:57.574705 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4554563a-d762-4ded-9ecd-a2cb3a80c806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:57.575153 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4554563a-d762-4ded-9ecd-a2cb3a80c806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:57.575597 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4554563a-d762-4ded-9ecd-a2cb3a80c806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:57.706400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4554563a-d762-4ded-9ecd-a2cb3a80c806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:57.714009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4554563a-d762-4ded-9ecd-a2cb3a80c806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.152423 Sep 09 21:25:57.714556 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 51/95] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:57 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:57.802299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4ed276e0-50f7-436d-8a5f-e1eeac78867e tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:57.802830 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4ed276e0-50f7-436d-8a5f-e1eeac78867e tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:57.808826 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ed276e0-50f7-436d-8a5f-e1eeac78867e tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:57.809310 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ed276e0-50f7-436d-8a5f-e1eeac78867e tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:57.809748 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ed276e0-50f7-436d-8a5f-e1eeac78867e tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:57.810432 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ed276e0-50f7-436d-8a5f-e1eeac78867e tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:57.810893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ed276e0-50f7-436d-8a5f-e1eeac78867e tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:57.811319 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ed276e0-50f7-436d-8a5f-e1eeac78867e tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:57.937901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4ed276e0-50f7-436d-8a5f-e1eeac78867e tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:57.945392 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4ed276e0-50f7-436d-8a5f-e1eeac78867e tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.147521 Sep 09 21:25:57.945951 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 45/96] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:57 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:58.022821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:58.023462 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:58.029338 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:58.029824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:58.030259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:58.031128 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:58.031605 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:58.032028 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:58.036471 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=100 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:58.169111 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:58.179582 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:58.181380 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:58.182232 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-25d9855b-ba35-4673-b3e8-021e0553fb39 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.164124 Sep 09 21:25:58.182844 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 52/97] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:58 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:58.736925 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a8f11d58-b409-405c-b451-0e5a3b565a8a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:58.737644 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a8f11d58-b409-405c-b451-0e5a3b565a8a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:58.744339 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8f11d58-b409-405c-b451-0e5a3b565a8a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:58.744826 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8f11d58-b409-405c-b451-0e5a3b565a8a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:58.745260 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8f11d58-b409-405c-b451-0e5a3b565a8a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:58.746033 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8f11d58-b409-405c-b451-0e5a3b565a8a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:58.746383 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8f11d58-b409-405c-b451-0e5a3b565a8a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:58.746811 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8f11d58-b409-405c-b451-0e5a3b565a8a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:58.766456 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=100 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:25:58.881728 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a8f11d58-b409-405c-b451-0e5a3b565a8a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:58.889315 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a8f11d58-b409-405c-b451-0e5a3b565a8a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.156188 Sep 09 21:25:58.889889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 46/98] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:58 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:58.968347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-71d630ec-6859-4442-9338-dd0d079bac81 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:58.968950 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-71d630ec-6859-4442-9338-dd0d079bac81 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:58.974891 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-71d630ec-6859-4442-9338-dd0d079bac81 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:58.975371 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-71d630ec-6859-4442-9338-dd0d079bac81 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:58.975826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-71d630ec-6859-4442-9338-dd0d079bac81 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:58.976501 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-71d630ec-6859-4442-9338-dd0d079bac81 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:58.976948 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-71d630ec-6859-4442-9338-dd0d079bac81 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:58.977367 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-71d630ec-6859-4442-9338-dd0d079bac81 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:59.108520 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-71d630ec-6859-4442-9338-dd0d079bac81 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:59.116931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-71d630ec-6859-4442-9338-dd0d079bac81 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.152375 Sep 09 21:25:59.117490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 53/99] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:58 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:25:59.206666 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:59.207996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:59.214337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:59.214895 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:59.215335 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:59.216335 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:59.216952 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:59.217393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:59.372576 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:59.382312 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:59.384345 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:59.385842 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d3f107dd-b679-4554-aa40-4268f94b8dcd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.183273 Sep 09 21:25:59.386388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 47/100] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:25:59 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:25:59.918520 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b858022d-f7e4-42e7-93b0-e264d7b077ee tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:59.919135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b858022d-f7e4-42e7-93b0-e264d7b077ee tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:59.934534 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b858022d-f7e4-42e7-93b0-e264d7b077ee tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:59.935123 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b858022d-f7e4-42e7-93b0-e264d7b077ee tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:59.935497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b858022d-f7e4-42e7-93b0-e264d7b077ee tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:59.936254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b858022d-f7e4-42e7-93b0-e264d7b077ee tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:59.937365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b858022d-f7e4-42e7-93b0-e264d7b077ee tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:59.937802 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b858022d-f7e4-42e7-93b0-e264d7b077ee tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:00.099401 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b858022d-f7e4-42e7-93b0-e264d7b077ee tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:00.108631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b858022d-f7e4-42e7-93b0-e264d7b077ee tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.194936 Sep 09 21:26:00.109728 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 54/101] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:59 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:00.142551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-39dbee5b-bd54-42cb-8148-2c2a9c8e0aa6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:00.143215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-39dbee5b-bd54-42cb-8148-2c2a9c8e0aa6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:00.165125 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-39dbee5b-bd54-42cb-8148-2c2a9c8e0aa6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:00.167916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-39dbee5b-bd54-42cb-8148-2c2a9c8e0aa6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:00.168640 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-39dbee5b-bd54-42cb-8148-2c2a9c8e0aa6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:00.170674 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-39dbee5b-bd54-42cb-8148-2c2a9c8e0aa6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:00.173689 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-39dbee5b-bd54-42cb-8148-2c2a9c8e0aa6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:00.174478 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-39dbee5b-bd54-42cb-8148-2c2a9c8e0aa6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:00.412736 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:00.413473 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:00.428099 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:00.428607 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:00.429430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:00.430373 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:00.432047 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:00.433030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:00.468361 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-39dbee5b-bd54-42cb-8148-2c2a9c8e0aa6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:00.480313 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-39dbee5b-bd54-42cb-8148-2c2a9c8e0aa6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.343926 Sep 09 21:26:00.480899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 48/102] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:00 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:00.768479 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:00.787788 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:00.792863 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:00.795416 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4c6e940d-25ea-4fe8-8c7b-43982699608f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.389101 Sep 09 21:26:00.799481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 55/103] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:26:00 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:26:01.134822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5cb881a9-c3e1-418e-a2b9-3f7ca9397c5c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:01.135693 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5cb881a9-c3e1-418e-a2b9-3f7ca9397c5c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:01.150336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5cb881a9-c3e1-418e-a2b9-3f7ca9397c5c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:01.151526 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5cb881a9-c3e1-418e-a2b9-3f7ca9397c5c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:01.152643 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5cb881a9-c3e1-418e-a2b9-3f7ca9397c5c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:01.154472 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5cb881a9-c3e1-418e-a2b9-3f7ca9397c5c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:01.156383 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5cb881a9-c3e1-418e-a2b9-3f7ca9397c5c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:01.157039 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5cb881a9-c3e1-418e-a2b9-3f7ca9397c5c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:01.506850 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ee1ce28e-5ee2-466d-8abc-e591f68ea2b1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:01.507484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ee1ce28e-5ee2-466d-8abc-e591f68ea2b1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:01.516131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1ce28e-5ee2-466d-8abc-e591f68ea2b1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:01.524291 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1ce28e-5ee2-466d-8abc-e591f68ea2b1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:01.525086 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1ce28e-5ee2-466d-8abc-e591f68ea2b1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:01.526008 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1ce28e-5ee2-466d-8abc-e591f68ea2b1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:01.526654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1ce28e-5ee2-466d-8abc-e591f68ea2b1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:01.527569 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1ce28e-5ee2-466d-8abc-e591f68ea2b1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:01.664215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5cb881a9-c3e1-418e-a2b9-3f7ca9397c5c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:01.677791 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5cb881a9-c3e1-418e-a2b9-3f7ca9397c5c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.549849 Sep 09 21:26:01.687692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 49/104] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:01 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:01.832177 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:01.832177 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:01.834692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:01.835733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:01.836343 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:01.838448 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:01.839159 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:01.839775 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:01.892979 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ee1ce28e-5ee2-466d-8abc-e591f68ea2b1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:01.908482 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ee1ce28e-5ee2-466d-8abc-e591f68ea2b1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.406222 Sep 09 21:26:01.909056 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 56/105] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:01 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:26:02.103852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:02.121206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:02.123071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:02.124356 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0f7d0c7f-ff9e-42c4-ba02-94f46366507e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.301093 Sep 09 21:26:02.135980 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 50/106] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:26:01 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:26:02.704936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f88c6650-4e1e-4b78-8b57-9b3fe4824613 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:02.706321 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f88c6650-4e1e-4b78-8b57-9b3fe4824613 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:02.716309 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f88c6650-4e1e-4b78-8b57-9b3fe4824613 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:02.718339 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f88c6650-4e1e-4b78-8b57-9b3fe4824613 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:02.719484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f88c6650-4e1e-4b78-8b57-9b3fe4824613 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:02.722188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f88c6650-4e1e-4b78-8b57-9b3fe4824613 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:02.724554 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f88c6650-4e1e-4b78-8b57-9b3fe4824613 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:02.725727 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f88c6650-4e1e-4b78-8b57-9b3fe4824613 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:02.916641 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f88c6650-4e1e-4b78-8b57-9b3fe4824613 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:02.924403 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f88c6650-4e1e-4b78-8b57-9b3fe4824613 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.224217 Sep 09 21:26:02.924970 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 57/107] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:02 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:02.946397 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-00964620-f3cf-4fca-aa6d-d0896e8f6e72 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:02.947002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-00964620-f3cf-4fca-aa6d-d0896e8f6e72 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:02.954027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-00964620-f3cf-4fca-aa6d-d0896e8f6e72 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:02.954516 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-00964620-f3cf-4fca-aa6d-d0896e8f6e72 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:02.955125 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-00964620-f3cf-4fca-aa6d-d0896e8f6e72 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:02.955984 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-00964620-f3cf-4fca-aa6d-d0896e8f6e72 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:02.956581 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-00964620-f3cf-4fca-aa6d-d0896e8f6e72 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:02.957838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-00964620-f3cf-4fca-aa6d-d0896e8f6e72 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:03.151593 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:03.152490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:03.158543 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:03.159436 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:03.159974 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:03.171916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-00964620-f3cf-4fca-aa6d-d0896e8f6e72 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:03.172469 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:03.172469 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:03.172469 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:03.182650 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-00964620-f3cf-4fca-aa6d-d0896e8f6e72 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.241406 Sep 09 21:26:03.200224 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 51/108] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:02 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:03.334499 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:03.344152 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:03.345904 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:03.347506 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1fc96e23-a0b7-4012-9100-84b548d9ea55 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.200351 Sep 09 21:26:03.349152 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 58/109] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:26:03 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:26:03.955202 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1c731b9c-8568-4ad6-b747-2dea74eb6b49 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:03.956009 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1c731b9c-8568-4ad6-b747-2dea74eb6b49 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:03.966810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c731b9c-8568-4ad6-b747-2dea74eb6b49 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:03.967460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c731b9c-8568-4ad6-b747-2dea74eb6b49 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:03.968796 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c731b9c-8568-4ad6-b747-2dea74eb6b49 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:03.969512 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c731b9c-8568-4ad6-b747-2dea74eb6b49 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:03.973744 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c731b9c-8568-4ad6-b747-2dea74eb6b49 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:03.976114 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c731b9c-8568-4ad6-b747-2dea74eb6b49 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:04.210583 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8360d77f-5d51-4012-a8f8-ce6b59eee7e6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:04.211268 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8360d77f-5d51-4012-a8f8-ce6b59eee7e6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:04.218791 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8360d77f-5d51-4012-a8f8-ce6b59eee7e6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:04.219277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8360d77f-5d51-4012-a8f8-ce6b59eee7e6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:04.219752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8360d77f-5d51-4012-a8f8-ce6b59eee7e6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:04.220437 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8360d77f-5d51-4012-a8f8-ce6b59eee7e6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:04.222477 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1c731b9c-8568-4ad6-b747-2dea74eb6b49 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:04.227139 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8360d77f-5d51-4012-a8f8-ce6b59eee7e6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:04.227802 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8360d77f-5d51-4012-a8f8-ce6b59eee7e6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:04.236466 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1c731b9c-8568-4ad6-b747-2dea74eb6b49 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.288044 Sep 09 21:26:04.237889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 52/110] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:03 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:04.385547 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:04.463966 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-516bb8d5-b9c5-412a-8b73-51482f5f4a8c req-fe9ce5fd-86ee-4386-a213-85703a516e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b02a0c-2af0-4acc-b06a-4b0cc6fc168d", "name": "network-vif-plugged", "status": "completed", "tag": "881bfd68-38cc-4849-929e-a49f51999764"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:04.482440 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-516bb8d5-b9c5-412a-8b73-51482f5f4a8c req-fe9ce5fd-86ee-4386-a213-85703a516e4c service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:04.483857 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-516bb8d5-b9c5-412a-8b73-51482f5f4a8c req-fe9ce5fd-86ee-4386-a213-85703a516e4c service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:04.484801 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-516bb8d5-b9c5-412a-8b73-51482f5f4a8c req-fe9ce5fd-86ee-4386-a213-85703a516e4c service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:04.510688 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-516bb8d5-b9c5-412a-8b73-51482f5f4a8c req-fe9ce5fd-86ee-4386-a213-85703a516e4c service nova] Creating event network-vif-plugged:881bfd68-38cc-4849-929e-a49f51999764 for instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d on hv-cinder-85221 Sep 09 21:26:04.517494 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-516bb8d5-b9c5-412a-8b73-51482f5f4a8c req-fe9ce5fd-86ee-4386-a213-85703a516e4c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278048 Sep 09 21:26:04.518432 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 53/111] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:26:04.527006 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:04.528844 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:04.532879 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8360d77f-5d51-4012-a8f8-ce6b59eee7e6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:04.537787 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:04.538281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:04.538954 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:04.539745 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:04.540359 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:04.540933 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:04.549181 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8360d77f-5d51-4012-a8f8-ce6b59eee7e6 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.343468 Sep 09 21:26:04.554627 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 59/112] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:04 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:26:04.721355 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:04.733855 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:04.735675 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:04.736998 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-82a04f53-dc2a-4d65-bb6b-029eadf75c33 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.216232 Sep 09 21:26:04.737726 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 54/113] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:26:04 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:26:05.271885 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e12e6f43-20ff-4a73-a1f0-4b0d25244ccd tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:05.273273 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e12e6f43-20ff-4a73-a1f0-4b0d25244ccd tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:05.282767 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e12e6f43-20ff-4a73-a1f0-4b0d25244ccd tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:05.283600 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e12e6f43-20ff-4a73-a1f0-4b0d25244ccd tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:05.284635 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e12e6f43-20ff-4a73-a1f0-4b0d25244ccd tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:05.285758 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e12e6f43-20ff-4a73-a1f0-4b0d25244ccd tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:05.286692 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e12e6f43-20ff-4a73-a1f0-4b0d25244ccd tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:05.287464 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e12e6f43-20ff-4a73-a1f0-4b0d25244ccd tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:05.521616 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e12e6f43-20ff-4a73-a1f0-4b0d25244ccd tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:05.532142 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e12e6f43-20ff-4a73-a1f0-4b0d25244ccd tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.268750 Sep 09 21:26:05.533347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 60/114] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:05 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:05.576745 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-19203adf-308a-4ef3-b408-2e5c5a08f18b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:05.577460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-19203adf-308a-4ef3-b408-2e5c5a08f18b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:05.586652 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-19203adf-308a-4ef3-b408-2e5c5a08f18b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:05.588004 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-19203adf-308a-4ef3-b408-2e5c5a08f18b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:05.588731 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-19203adf-308a-4ef3-b408-2e5c5a08f18b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:05.589760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-19203adf-308a-4ef3-b408-2e5c5a08f18b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:05.590919 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-19203adf-308a-4ef3-b408-2e5c5a08f18b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:05.591585 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-19203adf-308a-4ef3-b408-2e5c5a08f18b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:05.765161 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:05.766717 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:05.785633 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-19203adf-308a-4ef3-b408-2e5c5a08f18b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:05.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:05.791745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:05.792546 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:05.793274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:05.793923 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:05.794365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:05.799257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-19203adf-308a-4ef3-b408-2e5c5a08f18b tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.226735 Sep 09 21:26:05.802138 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 55/115] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:05 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:05.995104 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:06.006366 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:06.007989 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:06.009772 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-96abeb70-10b4-45f9-955c-adb910fd1324 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.250287 Sep 09 21:26:06.011678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 61/116] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:26:05 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:26:06.559734 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d0aaaa8e-7a19-4d08-94a9-586eb73103fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:06.560346 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d0aaaa8e-7a19-4d08-94a9-586eb73103fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:06.569084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0aaaa8e-7a19-4d08-94a9-586eb73103fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:06.572083 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0aaaa8e-7a19-4d08-94a9-586eb73103fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:06.572546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0aaaa8e-7a19-4d08-94a9-586eb73103fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:06.573347 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0aaaa8e-7a19-4d08-94a9-586eb73103fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:06.573808 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0aaaa8e-7a19-4d08-94a9-586eb73103fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:06.574935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0aaaa8e-7a19-4d08-94a9-586eb73103fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:06.826138 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-eab5565e-dd6f-483e-add1-4365c5b4c81c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:06.827386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-eab5565e-dd6f-483e-add1-4365c5b4c81c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:06.839765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eab5565e-dd6f-483e-add1-4365c5b4c81c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:06.841729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eab5565e-dd6f-483e-add1-4365c5b4c81c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:06.842411 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eab5565e-dd6f-483e-add1-4365c5b4c81c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:06.843412 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eab5565e-dd6f-483e-add1-4365c5b4c81c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:06.844113 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eab5565e-dd6f-483e-add1-4365c5b4c81c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:06.844766 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eab5565e-dd6f-483e-add1-4365c5b4c81c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:07.000644 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d0aaaa8e-7a19-4d08-94a9-586eb73103fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:07.014225 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d0aaaa8e-7a19-4d08-94a9-586eb73103fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.456523 Sep 09 21:26:07.015940 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 56/117] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:06 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:07.038837 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:07.040740 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:07.049415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:07.051620 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:07.052370 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:07.054097 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:07.054969 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:07.055628 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:07.181863 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-eab5565e-dd6f-483e-add1-4365c5b4c81c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:07.194112 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-eab5565e-dd6f-483e-add1-4365c5b4c81c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.371643 Sep 09 21:26:07.205982 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 62/118] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:06 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:07.350052 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:07.361608 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:07.363982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:07.365398 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-75e623b8-ca84-42f5-987e-7d98b202fcc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.332654 Sep 09 21:26:07.368101 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 57/119] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:26:07 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:26:08.040214 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6ccdde5d-cf0b-4d21-845c-70d807ac2c08 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:08.040830 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6ccdde5d-cf0b-4d21-845c-70d807ac2c08 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:08.052087 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6ccdde5d-cf0b-4d21-845c-70d807ac2c08 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:08.054066 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6ccdde5d-cf0b-4d21-845c-70d807ac2c08 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:08.055443 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6ccdde5d-cf0b-4d21-845c-70d807ac2c08 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:08.056407 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6ccdde5d-cf0b-4d21-845c-70d807ac2c08 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:08.058106 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6ccdde5d-cf0b-4d21-845c-70d807ac2c08 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:08.059832 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6ccdde5d-cf0b-4d21-845c-70d807ac2c08 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:08.156144 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-be220f05-dcb5-4d3a-b506-5177e0c92ab9 req-eae6abd7-9f69-46ff-b633-494ff171131d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8f74a7-256c-4810-944b-e4f66773aa13", "name": "network-vif-plugged", "status": "completed", "tag": "b28ee03c-d6a8-454c-b9c8-a9a10b589dbc"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:08.185505 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-be220f05-dcb5-4d3a-b506-5177e0c92ab9 req-eae6abd7-9f69-46ff-b633-494ff171131d service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:08.186950 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-be220f05-dcb5-4d3a-b506-5177e0c92ab9 req-eae6abd7-9f69-46ff-b633-494ff171131d service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:08.188104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-be220f05-dcb5-4d3a-b506-5177e0c92ab9 req-eae6abd7-9f69-46ff-b633-494ff171131d service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:08.203457 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-be220f05-dcb5-4d3a-b506-5177e0c92ab9 req-eae6abd7-9f69-46ff-b633-494ff171131d service nova] Creating event network-vif-plugged:b28ee03c-d6a8-454c-b9c8-a9a10b589dbc for instance cb8f74a7-256c-4810-944b-e4f66773aa13 on hv-cinder-85221 Sep 09 21:26:08.210079 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-be220f05-dcb5-4d3a-b506-5177e0c92ab9 req-eae6abd7-9f69-46ff-b633-494ff171131d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058512 Sep 09 21:26:08.211411 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 58/120] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:26:08.226086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d99cfd5e-9fc1-44e1-9d95-0e58cb89da05 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:08.227256 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d99cfd5e-9fc1-44e1-9d95-0e58cb89da05 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:08.235452 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d99cfd5e-9fc1-44e1-9d95-0e58cb89da05 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:08.236435 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d99cfd5e-9fc1-44e1-9d95-0e58cb89da05 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:08.237135 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d99cfd5e-9fc1-44e1-9d95-0e58cb89da05 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:08.238093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d99cfd5e-9fc1-44e1-9d95-0e58cb89da05 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:08.239947 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d99cfd5e-9fc1-44e1-9d95-0e58cb89da05 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:08.240594 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d99cfd5e-9fc1-44e1-9d95-0e58cb89da05 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:08.328554 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6ccdde5d-cf0b-4d21-845c-70d807ac2c08 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:08.337649 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6ccdde5d-cf0b-4d21-845c-70d807ac2c08 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.302639 Sep 09 21:26:08.338854 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 63/121] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:08 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:08.391138 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:08.391767 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:08.406388 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:08.407125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:08.411253 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:08.412428 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:08.413081 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:08.413726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:08.468622 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d99cfd5e-9fc1-44e1-9d95-0e58cb89da05 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:08.486870 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d99cfd5e-9fc1-44e1-9d95-0e58cb89da05 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1315 microversion: 2.1 time: 0.271905 Sep 09 21:26:08.487632 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 59/122] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:08 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:26:08.858918 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:08.867306 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:08.874117 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:08.882698 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ea8e201c-c281-4d23-a820-8598d1ebe1b3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.495357 Sep 09 21:26:08.883812 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 64/123] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:26:08 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:26:09.361500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-002c345b-e1c7-43d8-93e7-b44445e0ab40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:09.362133 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-002c345b-e1c7-43d8-93e7-b44445e0ab40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:09.372936 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-002c345b-e1c7-43d8-93e7-b44445e0ab40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.373471 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-002c345b-e1c7-43d8-93e7-b44445e0ab40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.373915 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-002c345b-e1c7-43d8-93e7-b44445e0ab40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:09.375980 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-002c345b-e1c7-43d8-93e7-b44445e0ab40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.376452 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-002c345b-e1c7-43d8-93e7-b44445e0ab40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.376953 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-002c345b-e1c7-43d8-93e7-b44445e0ab40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:09.511238 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0a7d18e9-2e5d-4653-8465-988d12795ae7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:09.512823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0a7d18e9-2e5d-4653-8465-988d12795ae7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:09.527383 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a7d18e9-2e5d-4653-8465-988d12795ae7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.528329 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a7d18e9-2e5d-4653-8465-988d12795ae7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.528973 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a7d18e9-2e5d-4653-8465-988d12795ae7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:09.530175 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a7d18e9-2e5d-4653-8465-988d12795ae7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.530858 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a7d18e9-2e5d-4653-8465-988d12795ae7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.531687 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0a7d18e9-2e5d-4653-8465-988d12795ae7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:09.619891 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-002c345b-e1c7-43d8-93e7-b44445e0ab40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:09.633404 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-002c345b-e1c7-43d8-93e7-b44445e0ab40 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.276260 Sep 09 21:26:09.648773 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 60/124] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:09 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:09.916257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:09.918049 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:09.937729 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.939187 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.943573 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:09.944843 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.945555 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.946190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:10.024552 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0a7d18e9-2e5d-4653-8465-988d12795ae7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:10.045259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0a7d18e9-2e5d-4653-8465-988d12795ae7 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1503 microversion: 2.1 time: 0.537900 Sep 09 21:26:10.047502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 65/125] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:09 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1503 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:26:10.330326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-a95ba081-1eaa-4792-b6bc-731855d474c1 req-979812b3-6ec9-4c0a-a08f-9c3c2182e8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27906035-8bb1-450e-bb91-c40551e1a437", "name": "network-vif-plugged", "status": "completed", "tag": "6bb94d88-fa7a-411f-a02b-1791dad73802"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:10.364019 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-a95ba081-1eaa-4792-b6bc-731855d474c1 req-979812b3-6ec9-4c0a-a08f-9c3c2182e8ab service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:10.366205 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-a95ba081-1eaa-4792-b6bc-731855d474c1 req-979812b3-6ec9-4c0a-a08f-9c3c2182e8ab service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:10.367010 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-a95ba081-1eaa-4792-b6bc-731855d474c1 req-979812b3-6ec9-4c0a-a08f-9c3c2182e8ab service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:10.398238 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:10.400924 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-a95ba081-1eaa-4792-b6bc-731855d474c1 req-979812b3-6ec9-4c0a-a08f-9c3c2182e8ab service nova] Creating event network-vif-plugged:6bb94d88-fa7a-411f-a02b-1791dad73802 for instance 27906035-8bb1-450e-bb91-c40551e1a437 on hv-cinder-85221 Sep 09 21:26:10.408853 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:10.413924 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:10.416698 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-a95ba081-1eaa-4792-b6bc-731855d474c1 req-979812b3-6ec9-4c0a-a08f-9c3c2182e8ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094762 Sep 09 21:26:10.417307 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 66/126] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:26:10.424475 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-23766766-103b-44bc-971b-bba2e00e7f4c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1408 microversion: 2.20 time: 0.517794 Sep 09 21:26:10.425253 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 61/127] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:26:09 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1408 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:26:10.664042 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ddf4753a-55ad-4203-b9b8-867ea91da017 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:10.665546 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ddf4753a-55ad-4203-b9b8-867ea91da017 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:10.685201 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ddf4753a-55ad-4203-b9b8-867ea91da017 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:10.685952 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ddf4753a-55ad-4203-b9b8-867ea91da017 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:10.687083 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ddf4753a-55ad-4203-b9b8-867ea91da017 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:10.690104 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ddf4753a-55ad-4203-b9b8-867ea91da017 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:10.690681 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ddf4753a-55ad-4203-b9b8-867ea91da017 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:10.692255 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ddf4753a-55ad-4203-b9b8-867ea91da017 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:10.880766 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ddf4753a-55ad-4203-b9b8-867ea91da017 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:10.889262 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ddf4753a-55ad-4203-b9b8-867ea91da017 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.231283 Sep 09 21:26:10.890399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 67/128] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:10 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:11.452817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:11.453966 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:11.468866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:11.469721 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:11.470540 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:11.471593 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:11.472243 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:11.473468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:11.647961 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:11.661301 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:11.664099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:11.665383 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-52b0a2d5-f73e-4a7f-aa05-a706c4bb21a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1600 microversion: 2.20 time: 0.217215 Sep 09 21:26:11.666064 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 62/129] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:26:11 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:26:11.690752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b9a68992-1d16-460c-8e32-6eb30554d392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:11.691865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b9a68992-1d16-460c-8e32-6eb30554d392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:11.697789 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a68992-1d16-460c-8e32-6eb30554d392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:11.698294 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a68992-1d16-460c-8e32-6eb30554d392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:11.698721 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a68992-1d16-460c-8e32-6eb30554d392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:11.699410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a68992-1d16-460c-8e32-6eb30554d392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:11.700047 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a68992-1d16-460c-8e32-6eb30554d392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:11.700609 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a68992-1d16-460c-8e32-6eb30554d392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:11.838105 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b9a68992-1d16-460c-8e32-6eb30554d392 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151131 Sep 09 21:26:11.839055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 68/130] 10.222.0.46 () {60 vars in 1316 bytes} [Fri Sep 9 21:26:11 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:26:11.914212 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9d7ed893-e407-4d29-bc1c-92486978162e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:11.915064 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9d7ed893-e407-4d29-bc1c-92486978162e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:11.923853 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9d7ed893-e407-4d29-bc1c-92486978162e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:11.924362 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9d7ed893-e407-4d29-bc1c-92486978162e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:11.924803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9d7ed893-e407-4d29-bc1c-92486978162e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:11.926444 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9d7ed893-e407-4d29-bc1c-92486978162e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:11.926947 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9d7ed893-e407-4d29-bc1c-92486978162e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:11.927568 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9d7ed893-e407-4d29-bc1c-92486978162e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:11.958759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ff42f62a-774a-4ed3-ac42-9493231b6d8f tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "300fdfb1-fbff-40ee-819a-750a715b477d"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:11.964465 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ff42f62a-774a-4ed3-ac42-9493231b6d8f tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:11.982054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff42f62a-774a-4ed3-ac42-9493231b6d8f tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:11.982434 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff42f62a-774a-4ed3-ac42-9493231b6d8f tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:11.982988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff42f62a-774a-4ed3-ac42-9493231b6d8f tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:11.990676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff42f62a-774a-4ed3-ac42-9493231b6d8f tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:11.991507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff42f62a-774a-4ed3-ac42-9493231b6d8f tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:11.991984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff42f62a-774a-4ed3-ac42-9493231b6d8f tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:12.219353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=100 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:12.398256 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-9d7ed893-e407-4d29-bc1c-92486978162e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:12.411647 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9d7ed893-e407-4d29-bc1c-92486978162e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1364 microversion: 2.1 time: 0.499632 Sep 09 21:26:12.414758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 63/131] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:11 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1364 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:12.826166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ff42f62a-774a-4ed3-ac42-9493231b6d8f tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "POST /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870802 Sep 09 21:26:12.827226 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 69/132] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:26:11 2022] POST /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:26:13.440937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-cc14b296-65a2-4400-9691-db63cf09f82a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:13.441674 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-cc14b296-65a2-4400-9691-db63cf09f82a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:13.453922 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc14b296-65a2-4400-9691-db63cf09f82a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:13.454767 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc14b296-65a2-4400-9691-db63cf09f82a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:13.458686 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc14b296-65a2-4400-9691-db63cf09f82a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:13.461074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc14b296-65a2-4400-9691-db63cf09f82a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:13.461684 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc14b296-65a2-4400-9691-db63cf09f82a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:13.464315 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc14b296-65a2-4400-9691-db63cf09f82a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:13.529251 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=100 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:13.819726 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-cc14b296-65a2-4400-9691-db63cf09f82a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:13.833556 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-cc14b296-65a2-4400-9691-db63cf09f82a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1550 microversion: 2.1 time: 0.394874 Sep 09 21:26:13.834994 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 64/133] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:13 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1550 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:13.859478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-090336a3-13c9-41bd-905b-33c969a825d9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:13.860055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-090336a3-13c9-41bd-905b-33c969a825d9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:13.866776 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-090336a3-13c9-41bd-905b-33c969a825d9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:13.867458 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-090336a3-13c9-41bd-905b-33c969a825d9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:13.867971 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-090336a3-13c9-41bd-905b-33c969a825d9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:13.868840 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-090336a3-13c9-41bd-905b-33c969a825d9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:13.869078 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-090336a3-13c9-41bd-905b-33c969a825d9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:13.869900 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-090336a3-13c9-41bd-905b-33c969a825d9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:13.983372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-090336a3-13c9-41bd-905b-33c969a825d9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128456 Sep 09 21:26:13.983992 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 70/134] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 21:26:13 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:26:14.251951 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-074be60d-1e87-4ae0-bf6b-eeae2da167fc req-70442751-09c8-45b8-8b8a-d215402894ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb8f74a7-256c-4810-944b-e4f66773aa13", "tag": "b28ee03c-d6a8-454c-b9c8-a9a10b589dbc"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:14.288407 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-074be60d-1e87-4ae0-bf6b-eeae2da167fc req-70442751-09c8-45b8-8b8a-d215402894ff service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:14.288814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-074be60d-1e87-4ae0-bf6b-eeae2da167fc req-70442751-09c8-45b8-8b8a-d215402894ff service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:14.294568 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-074be60d-1e87-4ae0-bf6b-eeae2da167fc req-70442751-09c8-45b8-8b8a-d215402894ff service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:14.342213 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-074be60d-1e87-4ae0-bf6b-eeae2da167fc req-70442751-09c8-45b8-8b8a-d215402894ff service nova] Creating event network-changed:b28ee03c-d6a8-454c-b9c8-a9a10b589dbc for instance cb8f74a7-256c-4810-944b-e4f66773aa13 on hv-cinder-85221 Sep 09 21:26:14.347967 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-074be60d-1e87-4ae0-bf6b-eeae2da167fc req-70442751-09c8-45b8-8b8a-d215402894ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101411 Sep 09 21:26:14.349169 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 65/135] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:26:16.615994 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-aec814ef-1c7c-4f3c-b240-d667ab1857a5 req-3e9ff5bb-bae7-4e1d-a1d2-f4c08019a87f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27906035-8bb1-450e-bb91-c40551e1a437", "tag": "6bb94d88-fa7a-411f-a02b-1791dad73802"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:16.629581 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-aec814ef-1c7c-4f3c-b240-d667ab1857a5 req-3e9ff5bb-bae7-4e1d-a1d2-f4c08019a87f service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:16.630413 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-aec814ef-1c7c-4f3c-b240-d667ab1857a5 req-3e9ff5bb-bae7-4e1d-a1d2-f4c08019a87f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:16.631302 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-aec814ef-1c7c-4f3c-b240-d667ab1857a5 req-3e9ff5bb-bae7-4e1d-a1d2-f4c08019a87f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:16.646574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-aec814ef-1c7c-4f3c-b240-d667ab1857a5 req-3e9ff5bb-bae7-4e1d-a1d2-f4c08019a87f service nova] Creating event network-changed:6bb94d88-fa7a-411f-a02b-1791dad73802 for instance 27906035-8bb1-450e-bb91-c40551e1a437 on hv-cinder-85221 Sep 09 21:26:16.652581 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-aec814ef-1c7c-4f3c-b240-d667ab1857a5 req-3e9ff5bb-bae7-4e1d-a1d2-f4c08019a87f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041542 Sep 09 21:26:16.654188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 71/136] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:26:26.216460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=65 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:26.217245 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=4 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:26.221179 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-446f8cd9-6c5c-4f70-acca-9ec7aaa4e66d tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:26.221759 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-446f8cd9-6c5c-4f70-acca-9ec7aaa4e66d tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:26.228967 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-446f8cd9-6c5c-4f70-acca-9ec7aaa4e66d tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:26.229468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-446f8cd9-6c5c-4f70-acca-9ec7aaa4e66d tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:26.229893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-446f8cd9-6c5c-4f70-acca-9ec7aaa4e66d tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:26.230624 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-446f8cd9-6c5c-4f70-acca-9ec7aaa4e66d tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:26.231067 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-446f8cd9-6c5c-4f70-acca-9ec7aaa4e66d tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:26.231492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-446f8cd9-6c5c-4f70-acca-9ec7aaa4e66d tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:26.258087 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-446f8cd9-6c5c-4f70-acca-9ec7aaa4e66d tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:26:26.391134 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-446f8cd9-6c5c-4f70-acca-9ec7aaa4e66d tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "DELETE /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 204 len: 0 microversion: 2.1 time: 0.175547 Sep 09 21:26:26.391843 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 66/137] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:26:26 2022] DELETE /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:26:26.400951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ec64c7f4-c236-46e6-80de-b4e149f5ca1a tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:26.401640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ec64c7f4-c236-46e6-80de-b4e149f5ca1a tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:26.403523 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=65 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:26.408884 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec64c7f4-c236-46e6-80de-b4e149f5ca1a tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:26.409575 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec64c7f4-c236-46e6-80de-b4e149f5ca1a tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:26.410009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec64c7f4-c236-46e6-80de-b4e149f5ca1a tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:26.410780 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec64c7f4-c236-46e6-80de-b4e149f5ca1a tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:26.411237 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec64c7f4-c236-46e6-80de-b4e149f5ca1a tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:26.411866 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec64c7f4-c236-46e6-80de-b4e149f5ca1a tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:26.544448 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ec64c7f4-c236-46e6-80de-b4e149f5ca1a tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:26.553391 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ec64c7f4-c236-46e6-80de-b4e149f5ca1a tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.157153 Sep 09 21:26:26.553942 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 72/138] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:26 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:27.576472 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-22096356-f017-4ab9-b2d8-ee2ba87b8c65 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:27.577152 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-22096356-f017-4ab9-b2d8-ee2ba87b8c65 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:27.583090 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22096356-f017-4ab9-b2d8-ee2ba87b8c65 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:27.583592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22096356-f017-4ab9-b2d8-ee2ba87b8c65 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:27.584023 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22096356-f017-4ab9-b2d8-ee2ba87b8c65 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:27.584698 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22096356-f017-4ab9-b2d8-ee2ba87b8c65 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:27.585145 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22096356-f017-4ab9-b2d8-ee2ba87b8c65 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:27.585564 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22096356-f017-4ab9-b2d8-ee2ba87b8c65 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:27.723028 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-22096356-f017-4ab9-b2d8-ee2ba87b8c65 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:27.731288 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-22096356-f017-4ab9-b2d8-ee2ba87b8c65 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.158945 Sep 09 21:26:27.731882 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 67/139] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:27 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:28.754763 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-22fe328f-0afd-40d0-a117-7b6a7ddfc756 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:28.755353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-22fe328f-0afd-40d0-a117-7b6a7ddfc756 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:28.761795 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22fe328f-0afd-40d0-a117-7b6a7ddfc756 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:28.762268 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22fe328f-0afd-40d0-a117-7b6a7ddfc756 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:28.762695 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22fe328f-0afd-40d0-a117-7b6a7ddfc756 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:28.763377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22fe328f-0afd-40d0-a117-7b6a7ddfc756 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:28.763857 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22fe328f-0afd-40d0-a117-7b6a7ddfc756 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:28.764273 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22fe328f-0afd-40d0-a117-7b6a7ddfc756 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:28.898517 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-22fe328f-0afd-40d0-a117-7b6a7ddfc756 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:28.906667 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-22fe328f-0afd-40d0-a117-7b6a7ddfc756 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.156251 Sep 09 21:26:28.907227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 73/140] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:28 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:29.929879 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5dc01059-e095-492d-a262-dab5883fca16 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:29.930482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5dc01059-e095-492d-a262-dab5883fca16 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:29.936368 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5dc01059-e095-492d-a262-dab5883fca16 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:29.936838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5dc01059-e095-492d-a262-dab5883fca16 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:29.937262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5dc01059-e095-492d-a262-dab5883fca16 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:29.937928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5dc01059-e095-492d-a262-dab5883fca16 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:29.938373 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5dc01059-e095-492d-a262-dab5883fca16 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:29.938786 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5dc01059-e095-492d-a262-dab5883fca16 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:30.069641 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5dc01059-e095-492d-a262-dab5883fca16 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:30.077666 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5dc01059-e095-492d-a262-dab5883fca16 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.151762 Sep 09 21:26:30.078233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 68/141] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:29 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:31.102456 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e4d1465c-623a-491e-890d-7bdaf4223b52 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:31.103081 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e4d1465c-623a-491e-890d-7bdaf4223b52 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:31.109955 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4d1465c-623a-491e-890d-7bdaf4223b52 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:31.110596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4d1465c-623a-491e-890d-7bdaf4223b52 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:31.111098 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4d1465c-623a-491e-890d-7bdaf4223b52 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:31.111909 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4d1465c-623a-491e-890d-7bdaf4223b52 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:31.113277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4d1465c-623a-491e-890d-7bdaf4223b52 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:31.114082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4d1465c-623a-491e-890d-7bdaf4223b52 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:31.261022 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e4d1465c-623a-491e-890d-7bdaf4223b52 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:31.269742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e4d1465c-623a-491e-890d-7bdaf4223b52 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.171240 Sep 09 21:26:31.270445 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 74/142] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:31 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:32.293738 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-90eeb6d6-d9a4-44c6-8a57-75c59553fba1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:32.294258 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-90eeb6d6-d9a4-44c6-8a57-75c59553fba1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:32.300182 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90eeb6d6-d9a4-44c6-8a57-75c59553fba1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:32.300819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90eeb6d6-d9a4-44c6-8a57-75c59553fba1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:32.301252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90eeb6d6-d9a4-44c6-8a57-75c59553fba1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:32.301925 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90eeb6d6-d9a4-44c6-8a57-75c59553fba1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:32.302373 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90eeb6d6-d9a4-44c6-8a57-75c59553fba1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:32.302788 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90eeb6d6-d9a4-44c6-8a57-75c59553fba1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:32.432257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-90eeb6d6-d9a4-44c6-8a57-75c59553fba1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:32.440266 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-90eeb6d6-d9a4-44c6-8a57-75c59553fba1 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.150425 Sep 09 21:26:32.440813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 69/143] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:32 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:33.463107 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7d3ef236-c117-489d-add6-ecd218628913 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:33.463741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7d3ef236-c117-489d-add6-ecd218628913 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:33.469942 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7d3ef236-c117-489d-add6-ecd218628913 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:33.470422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7d3ef236-c117-489d-add6-ecd218628913 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:33.470852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7d3ef236-c117-489d-add6-ecd218628913 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:33.471524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7d3ef236-c117-489d-add6-ecd218628913 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:33.472509 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7d3ef236-c117-489d-add6-ecd218628913 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:33.472931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7d3ef236-c117-489d-add6-ecd218628913 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:33.600865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7d3ef236-c117-489d-add6-ecd218628913 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:33.609700 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7d3ef236-c117-489d-add6-ecd218628913 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.150316 Sep 09 21:26:33.610410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 75/144] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:33 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:34.635154 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-308a8ab4-8b7d-40ba-94e3-1f3a9ff62724 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:34.635718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-308a8ab4-8b7d-40ba-94e3-1f3a9ff62724 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:34.641916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-308a8ab4-8b7d-40ba-94e3-1f3a9ff62724 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:34.642403 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-308a8ab4-8b7d-40ba-94e3-1f3a9ff62724 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:34.642841 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-308a8ab4-8b7d-40ba-94e3-1f3a9ff62724 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:34.643546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-308a8ab4-8b7d-40ba-94e3-1f3a9ff62724 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:34.644561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-308a8ab4-8b7d-40ba-94e3-1f3a9ff62724 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:34.644992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-308a8ab4-8b7d-40ba-94e3-1f3a9ff62724 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:34.776723 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-308a8ab4-8b7d-40ba-94e3-1f3a9ff62724 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:34.785654 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-308a8ab4-8b7d-40ba-94e3-1f3a9ff62724 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.154417 Sep 09 21:26:34.786329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 70/145] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:34 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:35.809541 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-fca23ba0-57b8-47a3-aae9-1587dc12f3b3 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:35.810209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-fca23ba0-57b8-47a3-aae9-1587dc12f3b3 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:35.817465 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fca23ba0-57b8-47a3-aae9-1587dc12f3b3 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:35.817950 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fca23ba0-57b8-47a3-aae9-1587dc12f3b3 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:35.818379 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fca23ba0-57b8-47a3-aae9-1587dc12f3b3 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:35.819089 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fca23ba0-57b8-47a3-aae9-1587dc12f3b3 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:35.819565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fca23ba0-57b8-47a3-aae9-1587dc12f3b3 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:35.819988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fca23ba0-57b8-47a3-aae9-1587dc12f3b3 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:35.963186 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-fca23ba0-57b8-47a3-aae9-1587dc12f3b3 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:35.971335 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-fca23ba0-57b8-47a3-aae9-1587dc12f3b3 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.166012 Sep 09 21:26:35.972140 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 76/146] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:35 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:36.995964 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-81886f17-7b2d-4b25-94cf-81428780a2a0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:36.996644 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-81886f17-7b2d-4b25-94cf-81428780a2a0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:37.005944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81886f17-7b2d-4b25-94cf-81428780a2a0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:37.006443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81886f17-7b2d-4b25-94cf-81428780a2a0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:37.006874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81886f17-7b2d-4b25-94cf-81428780a2a0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:37.008096 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81886f17-7b2d-4b25-94cf-81428780a2a0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:37.008551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81886f17-7b2d-4b25-94cf-81428780a2a0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:37.009204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81886f17-7b2d-4b25-94cf-81428780a2a0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:37.158893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-81886f17-7b2d-4b25-94cf-81428780a2a0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:37.168809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-81886f17-7b2d-4b25-94cf-81428780a2a0 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.177758 Sep 09 21:26:37.169842 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 71/147] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:36 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:38.202224 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7e9ea704-2d95-43dd-95dd-41d42d4a9e22 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:38.202828 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7e9ea704-2d95-43dd-95dd-41d42d4a9e22 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:38.209876 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e9ea704-2d95-43dd-95dd-41d42d4a9e22 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:38.210361 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e9ea704-2d95-43dd-95dd-41d42d4a9e22 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:38.210794 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e9ea704-2d95-43dd-95dd-41d42d4a9e22 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:38.211475 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e9ea704-2d95-43dd-95dd-41d42d4a9e22 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:38.211956 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e9ea704-2d95-43dd-95dd-41d42d4a9e22 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:38.212381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e9ea704-2d95-43dd-95dd-41d42d4a9e22 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:38.338521 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7e9ea704-2d95-43dd-95dd-41d42d4a9e22 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:38.347493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7e9ea704-2d95-43dd-95dd-41d42d4a9e22 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.148570 Sep 09 21:26:38.348312 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 77/148] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:38 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:39.370423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-41da867b-baf0-45bb-ae8d-50447be507c2 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:39.370950 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-41da867b-baf0-45bb-ae8d-50447be507c2 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:39.376757 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41da867b-baf0-45bb-ae8d-50447be507c2 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:39.377233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41da867b-baf0-45bb-ae8d-50447be507c2 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:39.377659 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41da867b-baf0-45bb-ae8d-50447be507c2 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:39.378916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41da867b-baf0-45bb-ae8d-50447be507c2 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:39.379359 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41da867b-baf0-45bb-ae8d-50447be507c2 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:39.379810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41da867b-baf0-45bb-ae8d-50447be507c2 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:39.509801 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-41da867b-baf0-45bb-ae8d-50447be507c2 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:39.517799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-41da867b-baf0-45bb-ae8d-50447be507c2 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.151448 Sep 09 21:26:39.518354 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 72/149] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:39 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:40.541377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-67eb7ae2-2fb5-4637-86d4-2c3d94ec57b4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:40.542038 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-67eb7ae2-2fb5-4637-86d4-2c3d94ec57b4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:40.548452 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67eb7ae2-2fb5-4637-86d4-2c3d94ec57b4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:40.548929 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67eb7ae2-2fb5-4637-86d4-2c3d94ec57b4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:40.549363 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67eb7ae2-2fb5-4637-86d4-2c3d94ec57b4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:40.550265 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67eb7ae2-2fb5-4637-86d4-2c3d94ec57b4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:40.550775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67eb7ae2-2fb5-4637-86d4-2c3d94ec57b4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:40.551196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67eb7ae2-2fb5-4637-86d4-2c3d94ec57b4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:40.687501 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-67eb7ae2-2fb5-4637-86d4-2c3d94ec57b4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:40.697130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-67eb7ae2-2fb5-4637-86d4-2c3d94ec57b4 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.159478 Sep 09 21:26:40.697705 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 78/150] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:40 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:41.720293 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-93150ab7-7384-41da-beec-bd86a8693de9 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:41.720908 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-93150ab7-7384-41da-beec-bd86a8693de9 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:41.728980 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-93150ab7-7384-41da-beec-bd86a8693de9 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:41.729476 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-93150ab7-7384-41da-beec-bd86a8693de9 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:41.729914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-93150ab7-7384-41da-beec-bd86a8693de9 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:41.730785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-93150ab7-7384-41da-beec-bd86a8693de9 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:41.731154 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-93150ab7-7384-41da-beec-bd86a8693de9 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:41.731635 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-93150ab7-7384-41da-beec-bd86a8693de9 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:41.886538 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-93150ab7-7384-41da-beec-bd86a8693de9 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:41.895832 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-93150ab7-7384-41da-beec-bd86a8693de9 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1555 microversion: 2.1 time: 0.179279 Sep 09 21:26:41.896384 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 73/151] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:41 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:42.728180 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-052edf35-c469-403c-b0d6-09f2cebc3b1e req-23f38009-923e-48ce-b72e-58da34056fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b02a0c-2af0-4acc-b06a-4b0cc6fc168d", "name": "network-vif-deleted", "tag": "881bfd68-38cc-4849-929e-a49f51999764"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:42.740047 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-052edf35-c469-403c-b0d6-09f2cebc3b1e req-23f38009-923e-48ce-b72e-58da34056fdc service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:42.740558 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-052edf35-c469-403c-b0d6-09f2cebc3b1e req-23f38009-923e-48ce-b72e-58da34056fdc service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:42.740986 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-052edf35-c469-403c-b0d6-09f2cebc3b1e req-23f38009-923e-48ce-b72e-58da34056fdc service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:42.743818 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:42.756470 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-052edf35-c469-403c-b0d6-09f2cebc3b1e req-23f38009-923e-48ce-b72e-58da34056fdc service nova] Creating event network-vif-deleted:881bfd68-38cc-4849-929e-a49f51999764 for instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d on hv-cinder-85221 Sep 09 21:26:42.764604 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-052edf35-c469-403c-b0d6-09f2cebc3b1e req-23f38009-923e-48ce-b72e-58da34056fdc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039971 Sep 09 21:26:42.765927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 79/152] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:26:42.920073 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a0838e8b-cc00-4946-804b-2a524319f3cb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:42.920764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a0838e8b-cc00-4946-804b-2a524319f3cb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:42.927279 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0838e8b-cc00-4946-804b-2a524319f3cb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:42.927814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0838e8b-cc00-4946-804b-2a524319f3cb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:42.928332 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0838e8b-cc00-4946-804b-2a524319f3cb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:42.929189 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0838e8b-cc00-4946-804b-2a524319f3cb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:42.929654 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0838e8b-cc00-4946-804b-2a524319f3cb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:42.930063 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0838e8b-cc00-4946-804b-2a524319f3cb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:42.991463 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a0838e8b-cc00-4946-804b-2a524319f3cb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:42.999523 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a0838e8b-cc00-4946-804b-2a524319f3cb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1346 microversion: 2.1 time: 0.083680 Sep 09 21:26:43.000099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 74/153] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:42 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:44.038586 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:44.039916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:44.053017 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:44.058697 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:44.059164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:44.060953 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:44.061557 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:44.062306 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:44.115474 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:44.116585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:44.117122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:44.117695 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lazy-loading 'fault' on Instance uuid 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:26:44.165591 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd147dfc8c648149712518771f7940c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '777c1bff7c024f91b0eafcad7fce29bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:44.177147 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8a17ebc1-9f95-4358-9150-a8cbc5fd2563 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 200 len: 1351 microversion: 2.1 time: 0.155587 Sep 09 21:26:44.178149 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 80/154] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:44 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 1351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:45.202838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:45.203997 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:45.210641 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:45.211096 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:45.211601 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:45.212245 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:45.212690 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:45.213460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:45.245782 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] HTTP exception thrown: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Request method failure captured: Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d HTTP/1.1 Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG689gGg-7cArSIxPrvxFgtrPt0FYYJjxefb4FcDuhwg6y8UK4GLtcEoyWDeKspUe5_2TSzcQoyHuS13vXE1UMMqgbipmnR5TXSv_FLuGrb3pIlddhVeebfz8x0ZQPHviX7UN6Fx9ne2HRTend7xAzymozHwrUsYt5xhdVMD2vtKj1As Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 777c1bff7c024f91b0eafcad7fce29bc Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:26:45.251366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_777c1bff7c024f91b0eafcad7fce29bc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/777c1bff7c024f91b0eafcad7fce29bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/777c1bff7c024f91b0eafcad7fce29bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/777c1bff7c024f91b0eafcad7fce29bc"}]}] Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 777c1bff7c024f91b0eafcad7fce29bc Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-DeleteServersTestJSON-1309812556-project Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: afd147dfc8c648149712518771f7940c Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-DeleteServersTestJSON-1309812556-project Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:45.252798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '22b02a0c-2af0-4acc-b06a-4b0cc6fc168d'} Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:26:45.253747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:45.255161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:26:45.258293 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Returning 404 to user: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:26:45.259304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4ba9ae8f-7c93-46f9-bc76-cb479dc274e8 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 404 len: 111 microversion: 2.1 time: 0.060994 Sep 09 21:26:45.264126 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 75/155] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:45 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:26:45.463638 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:45.465865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:45.478921 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:45.479357 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:45.479824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:45.480535 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:45.480997 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:45.482877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:45.497965 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] HTTP exception thrown: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Request method failure captured: Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d/os-volume_attachments HTTP/1.1 Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG689gGg-7cArSIxPrvxFgtrPt0FYYJjxefb4FcDuhwg6y8UK4GLtcEoyWDeKspUe5_2TSzcQoyHuS13vXE1UMMqgbipmnR5TXSv_FLuGrb3pIlddhVeebfz8x0ZQPHviX7UN6Fx9ne2HRTend7xAzymozHwrUsYt5xhdVMD2vtKj1As Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 777c1bff7c024f91b0eafcad7fce29bc Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:26:45.507467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_777c1bff7c024f91b0eafcad7fce29bc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/777c1bff7c024f91b0eafcad7fce29bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/777c1bff7c024f91b0eafcad7fce29bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/777c1bff7c024f91b0eafcad7fce29bc"}]}] Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 777c1bff7c024f91b0eafcad7fce29bc Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-DeleteServersTestJSON-1309812556-project Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: afd147dfc8c648149712518771f7940c Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-DeleteServersTestJSON-1309812556-project Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:45.508739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'server_id': '22b02a0c-2af0-4acc-b06a-4b0cc6fc168d'} Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:26:45.509430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:45.512930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:26:45.514055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Returning 404 to user: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:26:45.514055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-cc6ddefd-d916-4505-9262-fc567d9d1fbb tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049801 Sep 09 21:26:45.514055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 81/156] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:26:45 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:26:47.997319 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:47.997826 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:48.006146 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:48.007234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:48.007831 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:48.009334 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:48.009896 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:48.010259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:48.038854 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] HTTP exception thrown: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Request method failure captured: Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d HTTP/1.1 Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG689gGg-7cArSIxPrvxFgtrPt0FYYJjxefb4FcDuhwg6y8UK4GLtcEoyWDeKspUe5_2TSzcQoyHuS13vXE1UMMqgbipmnR5TXSv_FLuGrb3pIlddhVeebfz8x0ZQPHviX7UN6Fx9ne2HRTend7xAzymozHwrUsYt5xhdVMD2vtKj1As Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 777c1bff7c024f91b0eafcad7fce29bc Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:26:48.041582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_777c1bff7c024f91b0eafcad7fce29bc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/777c1bff7c024f91b0eafcad7fce29bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/777c1bff7c024f91b0eafcad7fce29bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/777c1bff7c024f91b0eafcad7fce29bc"}]}] Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 777c1bff7c024f91b0eafcad7fce29bc Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-DeleteServersTestJSON-1309812556-project Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: afd147dfc8c648149712518771f7940c Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-DeleteServersTestJSON-1309812556-project Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:48.042928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '22b02a0c-2af0-4acc-b06a-4b0cc6fc168d'} Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:26:48.043803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:48.045234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:26:48.047785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Returning 404 to user: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:26:48.048773 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-33bade96-cfca-4ead-a13f-0a31788d5b4c tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "DELETE /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 404 len: 111 microversion: 2.1 time: 0.056248 Sep 09 21:26:48.050278 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 76/157] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:26:47 2022] DELETE /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:26:48.063409 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:48.064108 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] [instance: 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:48.087687 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:48.088191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:48.088627 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:48.089329 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:48.089783 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:48.090216 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:48.120791 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] HTTP exception thrown: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Request method failure captured: Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d HTTP/1.1 Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG689gGg-7cArSIxPrvxFgtrPt0FYYJjxefb4FcDuhwg6y8UK4GLtcEoyWDeKspUe5_2TSzcQoyHuS13vXE1UMMqgbipmnR5TXSv_FLuGrb3pIlddhVeebfz8x0ZQPHviX7UN6Fx9ne2HRTend7xAzymozHwrUsYt5xhdVMD2vtKj1As Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 777c1bff7c024f91b0eafcad7fce29bc Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:26:48.123846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_777c1bff7c024f91b0eafcad7fce29bc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/777c1bff7c024f91b0eafcad7fce29bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/777c1bff7c024f91b0eafcad7fce29bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/777c1bff7c024f91b0eafcad7fce29bc"}]}] Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 777c1bff7c024f91b0eafcad7fce29bc Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-DeleteServersTestJSON-1309812556 Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-DeleteServersTestJSON-1309812556-project Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: afd147dfc8c648149712518771f7940c Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-DeleteServersTestJSON-1309812556-project Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:48.125275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '22b02a0c-2af0-4acc-b06a-4b0cc6fc168d'} Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:26:48.126243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. Sep 09 21:26:48.127507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:26:48.130178 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] Returning 404 to user: Instance 22b02a0c-2af0-4acc-b06a-4b0cc6fc168d could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:26:48.131412 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-25a570bf-68b0-420d-aa8e-b870f4763505 tempest-DeleteServersTestJSON-1309812556 tempest-DeleteServersTestJSON-1309812556-project] 10.222.0.46 "GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d" status: 404 len: 111 microversion: 2.1 time: 0.075561 Sep 09 21:26:48.137493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 82/158] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:48 2022] GET /compute/v2.1/servers/22b02a0c-2af0-4acc-b06a-4b0cc6fc168d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:26:57.322764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1240009345", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:57.332058 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:57.415896 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] validate_networks() for [('91289760-21fd-42ad-9632-180f81ec1122', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:26:57.863777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:26:57.864265 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:26:57.864830 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:26:57.866480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:26:57.866892 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:26:57.890676 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:57.891174 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:57.891642 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:57.895644 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:57.896290 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:57.896852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:57.904885 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:57.921039 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Getting quotas for project 5472cdfe59524ac5b826fba54758c68f. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:26:57.925721 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Getting quotas for user 0d773c7f6aca4ea2ad2872f67e9116af and project 5472cdfe59524ac5b826fba54758c68f. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:26:57.938409 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:26:57.941796 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:26:58.013115 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d6af2ee3-a17b-43ac-a900-4c0fb6376ee3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.811274 Sep 09 21:26:58.021242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 77/159] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:26:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:26:58.032682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9743a1ae-d97c-440b-9848-cfd85a257eb6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:58.033297 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9743a1ae-d97c-440b-9848-cfd85a257eb6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:58.053719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=24 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:58.119082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=13 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:58.176481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9743a1ae-d97c-440b-9848-cfd85a257eb6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:58.185134 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9743a1ae-d97c-440b-9848-cfd85a257eb6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1222 microversion: 2.1 time: 0.162691 Sep 09 21:26:58.187808 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 83/160] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:58 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:58.297209 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1721402570", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:58.426372 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] validate_networks() for [('91289760-21fd-42ad-9632-180f81ec1122', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:26:59.070010 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:26:59.070646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:26:59.071131 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:26:59.071710 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:26:59.072093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:26:59.083495 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:59.084167 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:59.084611 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:59.085341 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:59.085802 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:59.086235 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:59.103926 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Getting quotas for project 5472cdfe59524ac5b826fba54758c68f. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:26:59.108518 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Getting quotas for user 0d773c7f6aca4ea2ad2872f67e9116af and project 5472cdfe59524ac5b826fba54758c68f. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:26:59.123861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:26:59.126047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:26:59.187428 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-312707a8-3cf3-4e84-baac-63549970e252 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.899875 Sep 09 21:26:59.188120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 78/161] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:26:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:26:59.200671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-69850082-6852-40df-a9e2-835425ae078e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:59.201282 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-69850082-6852-40df-a9e2-835425ae078e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:59.281199 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-69850082-6852-40df-a9e2-835425ae078e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:59.289340 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-69850082-6852-40df-a9e2-835425ae078e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1222 microversion: 2.1 time: 0.092843 Sep 09 21:26:59.290391 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 84/162] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:59 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:00.312668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8c2d9f49-d342-491a-9507-1cf30d4f4b57 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:00.313948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8c2d9f49-d342-491a-9507-1cf30d4f4b57 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:00.332429 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c2d9f49-d342-491a-9507-1cf30d4f4b57 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:00.332947 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c2d9f49-d342-491a-9507-1cf30d4f4b57 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:00.333388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c2d9f49-d342-491a-9507-1cf30d4f4b57 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:00.334099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c2d9f49-d342-491a-9507-1cf30d4f4b57 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:00.334579 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c2d9f49-d342-491a-9507-1cf30d4f4b57 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:00.336816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c2d9f49-d342-491a-9507-1cf30d4f4b57 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:00.434101 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8c2d9f49-d342-491a-9507-1cf30d4f4b57 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:00.444192 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8c2d9f49-d342-491a-9507-1cf30d4f4b57 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1274 microversion: 2.1 time: 0.135397 Sep 09 21:27:00.445055 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 79/163] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:00 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:01.470488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0d265afb-ddf4-4a44-b15c-68aca3f1d765 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:01.478179 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0d265afb-ddf4-4a44-b15c-68aca3f1d765 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:01.499189 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0d265afb-ddf4-4a44-b15c-68aca3f1d765 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:01.500010 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0d265afb-ddf4-4a44-b15c-68aca3f1d765 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:01.500875 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0d265afb-ddf4-4a44-b15c-68aca3f1d765 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:01.502030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0d265afb-ddf4-4a44-b15c-68aca3f1d765 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:01.503701 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0d265afb-ddf4-4a44-b15c-68aca3f1d765 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:01.504444 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0d265afb-ddf4-4a44-b15c-68aca3f1d765 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:01.681255 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0d265afb-ddf4-4a44-b15c-68aca3f1d765 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:01.697118 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0d265afb-ddf4-4a44-b15c-68aca3f1d765 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1280 microversion: 2.1 time: 0.232407 Sep 09 21:27:01.708080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 85/164] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:01 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:02.727074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f634fdbf-5782-4212-ae24-15379b8d3115 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:02.729673 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f634fdbf-5782-4212-ae24-15379b8d3115 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:02.744276 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f634fdbf-5782-4212-ae24-15379b8d3115 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:02.744903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f634fdbf-5782-4212-ae24-15379b8d3115 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:02.745959 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f634fdbf-5782-4212-ae24-15379b8d3115 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:02.747697 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f634fdbf-5782-4212-ae24-15379b8d3115 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:02.748403 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f634fdbf-5782-4212-ae24-15379b8d3115 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:02.749079 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f634fdbf-5782-4212-ae24-15379b8d3115 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:02.861343 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f634fdbf-5782-4212-ae24-15379b8d3115 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:02.877943 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f634fdbf-5782-4212-ae24-15379b8d3115 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1280 microversion: 2.1 time: 0.154402 Sep 09 21:27:02.880690 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 80/165] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:02 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1280 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:03.048798 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-aeea5f1a-a483-4abf-94c9-319f1f85ad20 req-8b1c0551-8579-4bd3-86c4-20af6c427d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eedc741-6d4f-4cbd-9a25-a712414a9bbe", "tag": "5c478caa-364f-4a8c-86e9-be8edf26fbe4"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:03.076227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-aeea5f1a-a483-4abf-94c9-319f1f85ad20 req-8b1c0551-8579-4bd3-86c4-20af6c427d5f service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:03.081103 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-aeea5f1a-a483-4abf-94c9-319f1f85ad20 req-8b1c0551-8579-4bd3-86c4-20af6c427d5f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:03.082044 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-aeea5f1a-a483-4abf-94c9-319f1f85ad20 req-8b1c0551-8579-4bd3-86c4-20af6c427d5f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:03.100624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-aeea5f1a-a483-4abf-94c9-319f1f85ad20 req-8b1c0551-8579-4bd3-86c4-20af6c427d5f service nova] Creating event network-changed:5c478caa-364f-4a8c-86e9-be8edf26fbe4 for instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe on hv-cinder-85221 Sep 09 21:27:03.114296 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-aeea5f1a-a483-4abf-94c9-319f1f85ad20 req-8b1c0551-8579-4bd3-86c4-20af6c427d5f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074418 Sep 09 21:27:03.115709 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 86/166] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:27:03.906995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-34750f48-6a43-4f8d-83ae-fc2250190f79 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:03.907763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-34750f48-6a43-4f8d-83ae-fc2250190f79 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:03.923939 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34750f48-6a43-4f8d-83ae-fc2250190f79 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:03.925722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34750f48-6a43-4f8d-83ae-fc2250190f79 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:03.926469 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34750f48-6a43-4f8d-83ae-fc2250190f79 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:03.927725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34750f48-6a43-4f8d-83ae-fc2250190f79 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:03.929515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34750f48-6a43-4f8d-83ae-fc2250190f79 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:03.930437 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34750f48-6a43-4f8d-83ae-fc2250190f79 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:04.500854 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-34750f48-6a43-4f8d-83ae-fc2250190f79 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:04.512889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-34750f48-6a43-4f8d-83ae-fc2250190f79 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.610317 Sep 09 21:27:04.514449 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 81/167] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:03 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:05.180377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-10ed9fd5-1e0e-48e5-9228-297d96c6411b req-f7909416-1104-4b28-b851-ce7c3ade3c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3828efac-904c-481a-95a5-a84a7b581b83", "tag": "723c7e34-a091-4242-9709-6b7cea72ecf4"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:05.200454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-10ed9fd5-1e0e-48e5-9228-297d96c6411b req-f7909416-1104-4b28-b851-ce7c3ade3c56 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:05.201406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-10ed9fd5-1e0e-48e5-9228-297d96c6411b req-f7909416-1104-4b28-b851-ce7c3ade3c56 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:05.201941 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-10ed9fd5-1e0e-48e5-9228-297d96c6411b req-f7909416-1104-4b28-b851-ce7c3ade3c56 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:05.221521 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-10ed9fd5-1e0e-48e5-9228-297d96c6411b req-f7909416-1104-4b28-b851-ce7c3ade3c56 service nova] Creating event network-changed:723c7e34-a091-4242-9709-6b7cea72ecf4 for instance 3828efac-904c-481a-95a5-a84a7b581b83 on hv-cinder-85221 Sep 09 21:27:05.235213 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-10ed9fd5-1e0e-48e5-9228-297d96c6411b req-f7909416-1104-4b28-b851-ce7c3ade3c56 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065916 Sep 09 21:27:05.237318 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 87/168] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:27:05.540237 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-086ab251-d3b3-402e-96f3-7ee029fac10a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:05.540854 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-086ab251-d3b3-402e-96f3-7ee029fac10a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:05.550653 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086ab251-d3b3-402e-96f3-7ee029fac10a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:05.551711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086ab251-d3b3-402e-96f3-7ee029fac10a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:05.552320 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086ab251-d3b3-402e-96f3-7ee029fac10a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:05.553280 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086ab251-d3b3-402e-96f3-7ee029fac10a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:05.553992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086ab251-d3b3-402e-96f3-7ee029fac10a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:05.554450 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086ab251-d3b3-402e-96f3-7ee029fac10a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:05.769787 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-086ab251-d3b3-402e-96f3-7ee029fac10a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:05.780006 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-086ab251-d3b3-402e-96f3-7ee029fac10a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.243343 Sep 09 21:27:05.781350 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 82/169] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:05 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:06.806528 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-85906ba9-8f4c-4a42-b164-78a021c27353 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:06.807234 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-85906ba9-8f4c-4a42-b164-78a021c27353 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:06.814458 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-85906ba9-8f4c-4a42-b164-78a021c27353 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:06.815733 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-85906ba9-8f4c-4a42-b164-78a021c27353 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:06.816532 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-85906ba9-8f4c-4a42-b164-78a021c27353 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:06.817738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-85906ba9-8f4c-4a42-b164-78a021c27353 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:06.818427 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-85906ba9-8f4c-4a42-b164-78a021c27353 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:06.819177 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-85906ba9-8f4c-4a42-b164-78a021c27353 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:07.084377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-85906ba9-8f4c-4a42-b164-78a021c27353 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:07.101501 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-85906ba9-8f4c-4a42-b164-78a021c27353 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.299118 Sep 09 21:27:07.111583 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 88/170] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:06 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:08.126100 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-13121842-6d56-4b07-accf-cefe158bc351 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:08.126720 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-13121842-6d56-4b07-accf-cefe158bc351 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:08.138476 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-13121842-6d56-4b07-accf-cefe158bc351 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:08.139566 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-13121842-6d56-4b07-accf-cefe158bc351 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:08.140170 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-13121842-6d56-4b07-accf-cefe158bc351 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:08.141733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-13121842-6d56-4b07-accf-cefe158bc351 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:08.142539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-13121842-6d56-4b07-accf-cefe158bc351 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:08.143788 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-13121842-6d56-4b07-accf-cefe158bc351 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:08.384574 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-13121842-6d56-4b07-accf-cefe158bc351 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:08.394519 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-13121842-6d56-4b07-accf-cefe158bc351 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.272213 Sep 09 21:27:08.395407 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 83/171] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:08 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:09.420975 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9471c311-5deb-4536-b6b0-cba8cc48308a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:09.421600 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9471c311-5deb-4536-b6b0-cba8cc48308a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:09.424950 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=4 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:09.431688 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9471c311-5deb-4536-b6b0-cba8cc48308a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:09.432217 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9471c311-5deb-4536-b6b0-cba8cc48308a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:09.432618 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9471c311-5deb-4536-b6b0-cba8cc48308a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:09.433315 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9471c311-5deb-4536-b6b0-cba8cc48308a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:09.434018 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9471c311-5deb-4536-b6b0-cba8cc48308a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:09.434604 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9471c311-5deb-4536-b6b0-cba8cc48308a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:09.593308 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9471c311-5deb-4536-b6b0-cba8cc48308a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:09.601782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9471c311-5deb-4536-b6b0-cba8cc48308a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.186870 Sep 09 21:27:09.602344 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 89/172] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:09 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:10.630051 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-048bea13-08b2-43bf-a342-097af3e97b65 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:10.631661 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-048bea13-08b2-43bf-a342-097af3e97b65 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:10.641492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=4 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:10.642258 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=12 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:10.651138 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-048bea13-08b2-43bf-a342-097af3e97b65 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:10.651695 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-048bea13-08b2-43bf-a342-097af3e97b65 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:10.652138 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-048bea13-08b2-43bf-a342-097af3e97b65 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:10.652847 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-048bea13-08b2-43bf-a342-097af3e97b65 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:10.653299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-048bea13-08b2-43bf-a342-097af3e97b65 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:10.653917 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-048bea13-08b2-43bf-a342-097af3e97b65 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:10.819394 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-048bea13-08b2-43bf-a342-097af3e97b65 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:10.827617 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-048bea13-08b2-43bf-a342-097af3e97b65 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.202652 Sep 09 21:27:10.828358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 84/173] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:10 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:11.445420 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-f1a989e6-12ea-4cb9-af99-a06105d75e36 req-9e6929a6-0d9c-46b2-bcd9-b648fdf9b966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eedc741-6d4f-4cbd-9a25-a712414a9bbe", "name": "network-vif-plugged", "status": "completed", "tag": "5c478caa-364f-4a8c-86e9-be8edf26fbe4"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:11.465257 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-f1a989e6-12ea-4cb9-af99-a06105d75e36 req-9e6929a6-0d9c-46b2-bcd9-b648fdf9b966 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:11.468855 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-f1a989e6-12ea-4cb9-af99-a06105d75e36 req-9e6929a6-0d9c-46b2-bcd9-b648fdf9b966 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:11.480610 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-f1a989e6-12ea-4cb9-af99-a06105d75e36 req-9e6929a6-0d9c-46b2-bcd9-b648fdf9b966 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:11.497991 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-f1a989e6-12ea-4cb9-af99-a06105d75e36 req-9e6929a6-0d9c-46b2-bcd9-b648fdf9b966 service nova] Creating event network-vif-plugged:5c478caa-364f-4a8c-86e9-be8edf26fbe4 for instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe on hv-cinder-85221 Sep 09 21:27:11.504991 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-f1a989e6-12ea-4cb9-af99-a06105d75e36 req-9e6929a6-0d9c-46b2-bcd9-b648fdf9b966 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063366 Sep 09 21:27:11.506424 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 90/174] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:27:11.854172 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2b956204-8a26-4505-9a2a-8b3e8af9ad02 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:11.854885 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2b956204-8a26-4505-9a2a-8b3e8af9ad02 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:11.868893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2b956204-8a26-4505-9a2a-8b3e8af9ad02 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:11.869393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2b956204-8a26-4505-9a2a-8b3e8af9ad02 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:11.869858 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2b956204-8a26-4505-9a2a-8b3e8af9ad02 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:11.870566 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2b956204-8a26-4505-9a2a-8b3e8af9ad02 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:11.871021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2b956204-8a26-4505-9a2a-8b3e8af9ad02 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:11.871450 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2b956204-8a26-4505-9a2a-8b3e8af9ad02 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:12.078353 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2b956204-8a26-4505-9a2a-8b3e8af9ad02 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:12.088477 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2b956204-8a26-4505-9a2a-8b3e8af9ad02 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.239766 Sep 09 21:27:12.090215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 85/175] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:11 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:13.123296 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bbf4647b-32e5-4fc5-b3f5-e819ceb65db2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:13.124017 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bbf4647b-32e5-4fc5-b3f5-e819ceb65db2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:13.131726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bbf4647b-32e5-4fc5-b3f5-e819ceb65db2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:13.132220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bbf4647b-32e5-4fc5-b3f5-e819ceb65db2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:13.132656 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bbf4647b-32e5-4fc5-b3f5-e819ceb65db2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:13.133350 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bbf4647b-32e5-4fc5-b3f5-e819ceb65db2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:13.133802 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bbf4647b-32e5-4fc5-b3f5-e819ceb65db2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:13.134220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bbf4647b-32e5-4fc5-b3f5-e819ceb65db2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:13.316144 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bbf4647b-32e5-4fc5-b3f5-e819ceb65db2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:13.324714 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bbf4647b-32e5-4fc5-b3f5-e819ceb65db2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.205347 Sep 09 21:27:13.337371 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 91/176] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:13 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:14.347810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-dd356ea3-97d6-49a5-b1ce-496364a9a02a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:14.348428 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-dd356ea3-97d6-49a5-b1ce-496364a9a02a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:14.354311 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd356ea3-97d6-49a5-b1ce-496364a9a02a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:14.354808 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd356ea3-97d6-49a5-b1ce-496364a9a02a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:14.355245 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd356ea3-97d6-49a5-b1ce-496364a9a02a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:14.355953 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd356ea3-97d6-49a5-b1ce-496364a9a02a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:14.356412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd356ea3-97d6-49a5-b1ce-496364a9a02a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:14.356842 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd356ea3-97d6-49a5-b1ce-496364a9a02a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:14.482214 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-dd356ea3-97d6-49a5-b1ce-496364a9a02a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:14.489872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-dd356ea3-97d6-49a5-b1ce-496364a9a02a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.146563 Sep 09 21:27:14.490435 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 86/177] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:14 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:14.634630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1019353831", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "networks": [{"uuid": "90ee32ed-1b7c-403a-9874-6aba33139ecf"}]}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:14.687842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.network.neutron [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] validate_networks() for [('90ee32ed-1b7c-403a-9874-6aba33139ecf', None, None, None, None, None)] {{(pid=120465) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:27:15.278750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Flavor limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:27:15.279170 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Image limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:27:15.279678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Flavor pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:27:15.280089 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Image pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:27:15.280500 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:27:15.290735 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:15.291218 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:15.291690 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:15.292409 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:15.292867 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:15.293289 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:15.310309 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Getting quotas for project bdf0d6145a4848a8bc624ded77bc27ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:27:15.314929 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Getting quotas for user ba45eee6687b45158555ef5f0c595680 and project bdf0d6145a4848a8bc624ded77bc27ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:27:15.326381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Going to run 1 instances... {{(pid=120465) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:27:15.329181 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:27:15.364845 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-a6b68df9-c501-4ce7-8a9e-9e32a53251d7 req-4dbdc5ed-3730-4c96-913d-fe4949e40d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3828efac-904c-481a-95a5-a84a7b581b83", "name": "network-vif-plugged", "status": "completed", "tag": "723c7e34-a091-4242-9709-6b7cea72ecf4"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:15.379282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-a6b68df9-c501-4ce7-8a9e-9e32a53251d7 req-4dbdc5ed-3730-4c96-913d-fe4949e40d30 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:15.383664 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6afc03f9-218f-4e9c-b795-fbb211b0c0b3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749722 Sep 09 21:27:15.383664 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 92/178] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:27:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:27:15.384514 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-a6b68df9-c501-4ce7-8a9e-9e32a53251d7 req-4dbdc5ed-3730-4c96-913d-fe4949e40d30 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:15.385007 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-a6b68df9-c501-4ce7-8a9e-9e32a53251d7 req-4dbdc5ed-3730-4c96-913d-fe4949e40d30 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:15.393704 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-eba9f16a-cbb0-4308-9e50-75285b1a9b8e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:15.395569 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-eba9f16a-cbb0-4308-9e50-75285b1a9b8e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:15.413147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-a6b68df9-c501-4ce7-8a9e-9e32a53251d7 req-4dbdc5ed-3730-4c96-913d-fe4949e40d30 service nova] Creating event network-vif-plugged:723c7e34-a091-4242-9709-6b7cea72ecf4 for instance 3828efac-904c-481a-95a5-a84a7b581b83 on hv-cinder-85221 Sep 09 21:27:15.427744 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-a6b68df9-c501-4ce7-8a9e-9e32a53251d7 req-4dbdc5ed-3730-4c96-913d-fe4949e40d30 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066034 Sep 09 21:27:15.428635 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 87/179] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:27:15.475961 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-eba9f16a-cbb0-4308-9e50-75285b1a9b8e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:15.483597 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-eba9f16a-cbb0-4308-9e50-75285b1a9b8e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1214 microversion: 2.1 time: 0.094290 Sep 09 21:27:15.485841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 93/180] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:15 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:15.514658 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-604a26c0-6be9-4eb6-81ad-c904799a1614 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:15.515724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-604a26c0-6be9-4eb6-81ad-c904799a1614 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:15.525190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-604a26c0-6be9-4eb6-81ad-c904799a1614 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:15.525735 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-604a26c0-6be9-4eb6-81ad-c904799a1614 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:15.526174 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-604a26c0-6be9-4eb6-81ad-c904799a1614 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:15.528305 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-604a26c0-6be9-4eb6-81ad-c904799a1614 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:15.529619 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-604a26c0-6be9-4eb6-81ad-c904799a1614 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:15.542219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-604a26c0-6be9-4eb6-81ad-c904799a1614 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:15.769292 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-604a26c0-6be9-4eb6-81ad-c904799a1614 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:15.780016 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-604a26c0-6be9-4eb6-81ad-c904799a1614 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.271112 Sep 09 21:27:15.781554 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 88/181] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:15 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:16.506796 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8fef70f7-ebbe-4386-87d1-9dba44a9bf83 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:16.507338 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8fef70f7-ebbe-4386-87d1-9dba44a9bf83 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:16.513690 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8fef70f7-ebbe-4386-87d1-9dba44a9bf83 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:16.514168 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8fef70f7-ebbe-4386-87d1-9dba44a9bf83 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:16.514602 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8fef70f7-ebbe-4386-87d1-9dba44a9bf83 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:16.515280 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8fef70f7-ebbe-4386-87d1-9dba44a9bf83 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:16.515777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8fef70f7-ebbe-4386-87d1-9dba44a9bf83 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:16.516198 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8fef70f7-ebbe-4386-87d1-9dba44a9bf83 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:16.578019 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8fef70f7-ebbe-4386-87d1-9dba44a9bf83 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:16.586090 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8fef70f7-ebbe-4386-87d1-9dba44a9bf83 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1210 microversion: 2.1 time: 0.083184 Sep 09 21:27:16.586648 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 94/182] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:16 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:16.805228 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-005655f6-23d7-451a-a3f0-5b6db01ff1ed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:16.805817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-005655f6-23d7-451a-a3f0-5b6db01ff1ed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:16.812415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-005655f6-23d7-451a-a3f0-5b6db01ff1ed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:16.812907 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-005655f6-23d7-451a-a3f0-5b6db01ff1ed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:16.813359 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-005655f6-23d7-451a-a3f0-5b6db01ff1ed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:16.814090 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-005655f6-23d7-451a-a3f0-5b6db01ff1ed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:16.815315 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-005655f6-23d7-451a-a3f0-5b6db01ff1ed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:16.816038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-005655f6-23d7-451a-a3f0-5b6db01ff1ed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:16.963519 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-005655f6-23d7-451a-a3f0-5b6db01ff1ed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:16.971502 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-005655f6-23d7-451a-a3f0-5b6db01ff1ed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1322 microversion: 2.1 time: 0.170233 Sep 09 21:27:16.972598 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 89/183] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:16 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:17.612344 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-07034b0c-eda1-4928-bc68-c9d96fcb0c12 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:17.613787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-07034b0c-eda1-4928-bc68-c9d96fcb0c12 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:17.621598 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-07034b0c-eda1-4928-bc68-c9d96fcb0c12 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:17.622390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-07034b0c-eda1-4928-bc68-c9d96fcb0c12 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:17.623072 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-07034b0c-eda1-4928-bc68-c9d96fcb0c12 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:17.624110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-07034b0c-eda1-4928-bc68-c9d96fcb0c12 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:17.624791 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-07034b0c-eda1-4928-bc68-c9d96fcb0c12 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:17.625613 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-07034b0c-eda1-4928-bc68-c9d96fcb0c12 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:17.702801 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-07034b0c-eda1-4928-bc68-c9d96fcb0c12 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:17.715394 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-07034b0c-eda1-4928-bc68-c9d96fcb0c12 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1274 microversion: 2.1 time: 0.107127 Sep 09 21:27:17.716826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 95/184] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:17 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:17.994028 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8113f93c-855d-4bea-8543-2b4c2cc35986 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:17.994632 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8113f93c-855d-4bea-8543-2b4c2cc35986 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:18.000816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8113f93c-855d-4bea-8543-2b4c2cc35986 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:18.001510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8113f93c-855d-4bea-8543-2b4c2cc35986 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:18.002693 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8113f93c-855d-4bea-8543-2b4c2cc35986 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:18.003424 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8113f93c-855d-4bea-8543-2b4c2cc35986 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:18.003912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8113f93c-855d-4bea-8543-2b4c2cc35986 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:18.004356 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8113f93c-855d-4bea-8543-2b4c2cc35986 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:18.239785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8113f93c-855d-4bea-8543-2b4c2cc35986 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:18.250877 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8113f93c-855d-4bea-8543-2b4c2cc35986 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1516 microversion: 2.1 time: 0.260528 Sep 09 21:27:18.259785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 90/185] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:17 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1516 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:18.275922 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0203ef52-2835-4c33-b4e6-0dd66fa991b8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:18.278232 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0203ef52-2835-4c33-b4e6-0dd66fa991b8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:18.292563 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0203ef52-2835-4c33-b4e6-0dd66fa991b8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:18.293066 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0203ef52-2835-4c33-b4e6-0dd66fa991b8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:18.293506 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0203ef52-2835-4c33-b4e6-0dd66fa991b8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:18.294207 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0203ef52-2835-4c33-b4e6-0dd66fa991b8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:18.294660 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0203ef52-2835-4c33-b4e6-0dd66fa991b8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:18.295088 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0203ef52-2835-4c33-b4e6-0dd66fa991b8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:18.334018 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-0203ef52-2835-4c33-b4e6-0dd66fa991b8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lazy-loading 'flavor' on Instance uuid 3828efac-904c-481a-95a5-a84a7b581b83 {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:27:18.464474 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0203ef52-2835-4c33-b4e6-0dd66fa991b8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83/action" status: 200 len: 32 microversion: 2.1 time: 0.192972 Sep 09 21:27:18.465778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 96/186] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:27:18 2022] POST /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:27:18.480530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8c86106f-333f-4f7d-ab68-1965e51a9d88 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:18.481960 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8c86106f-333f-4f7d-ab68-1965e51a9d88 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:18.492520 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c86106f-333f-4f7d-ab68-1965e51a9d88 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:18.493028 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c86106f-333f-4f7d-ab68-1965e51a9d88 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:18.493478 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c86106f-333f-4f7d-ab68-1965e51a9d88 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:18.494279 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c86106f-333f-4f7d-ab68-1965e51a9d88 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:18.494904 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c86106f-333f-4f7d-ab68-1965e51a9d88 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:18.495415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c86106f-333f-4f7d-ab68-1965e51a9d88 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:18.743148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e0441fbe-6825-4a31-8786-f63c7a79d2d3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:18.743890 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e0441fbe-6825-4a31-8786-f63c7a79d2d3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:18.751888 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e0441fbe-6825-4a31-8786-f63c7a79d2d3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:18.760636 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e0441fbe-6825-4a31-8786-f63c7a79d2d3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:18.761441 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e0441fbe-6825-4a31-8786-f63c7a79d2d3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:18.763670 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e0441fbe-6825-4a31-8786-f63c7a79d2d3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:18.765256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e0441fbe-6825-4a31-8786-f63c7a79d2d3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:18.766104 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e0441fbe-6825-4a31-8786-f63c7a79d2d3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:18.848578 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8c86106f-333f-4f7d-ab68-1965e51a9d88 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:18.863090 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8c86106f-333f-4f7d-ab68-1965e51a9d88 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.390750 Sep 09 21:27:18.865535 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 91/187] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:18 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:18.923252 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e0441fbe-6825-4a31-8786-f63c7a79d2d3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:18.934449 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e0441fbe-6825-4a31-8786-f63c7a79d2d3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1272 microversion: 2.1 time: 0.199429 Sep 09 21:27:18.940109 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 97/188] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:18 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:19.889642 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-25da665c-e04d-4f9e-9bde-7c1d469979da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:19.890814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-25da665c-e04d-4f9e-9bde-7c1d469979da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:19.901987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25da665c-e04d-4f9e-9bde-7c1d469979da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:19.902648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25da665c-e04d-4f9e-9bde-7c1d469979da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:19.903256 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25da665c-e04d-4f9e-9bde-7c1d469979da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:19.904099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25da665c-e04d-4f9e-9bde-7c1d469979da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:19.904430 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25da665c-e04d-4f9e-9bde-7c1d469979da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:19.904852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25da665c-e04d-4f9e-9bde-7c1d469979da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:19.961172 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2fab9c8a-b803-4463-8d26-b160f7237fe2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:19.962367 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2fab9c8a-b803-4463-8d26-b160f7237fe2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:19.973035 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2fab9c8a-b803-4463-8d26-b160f7237fe2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:19.973742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2fab9c8a-b803-4463-8d26-b160f7237fe2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:19.974345 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2fab9c8a-b803-4463-8d26-b160f7237fe2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:19.975281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2fab9c8a-b803-4463-8d26-b160f7237fe2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:19.981574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2fab9c8a-b803-4463-8d26-b160f7237fe2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:19.982199 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2fab9c8a-b803-4463-8d26-b160f7237fe2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:20.157863 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-25da665c-e04d-4f9e-9bde-7c1d469979da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:20.169902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-25da665c-e04d-4f9e-9bde-7c1d469979da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.284017 Sep 09 21:27:20.170814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 92/189] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:19 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:20.180889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2fab9c8a-b803-4463-8d26-b160f7237fe2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:20.192742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2fab9c8a-b803-4463-8d26-b160f7237fe2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1314 microversion: 2.1 time: 0.235218 Sep 09 21:27:20.193469 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 98/190] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:19 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:21.145320 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-5406e48c-7e64-4891-a044-ccdb9a7aa3a1 req-e98db68d-a4c7-4e68-ad06-5c0deae18de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b23633-8172-45b0-8ed7-1cd782ea603d", "tag": "47450097-73fc-4399-a897-e58e8251e288"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:21.159971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-5406e48c-7e64-4891-a044-ccdb9a7aa3a1 req-e98db68d-a4c7-4e68-ad06-5c0deae18de3 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:21.160685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-5406e48c-7e64-4891-a044-ccdb9a7aa3a1 req-e98db68d-a4c7-4e68-ad06-5c0deae18de3 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:21.161274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-5406e48c-7e64-4891-a044-ccdb9a7aa3a1 req-e98db68d-a4c7-4e68-ad06-5c0deae18de3 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:21.174513 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-5406e48c-7e64-4891-a044-ccdb9a7aa3a1 req-e98db68d-a4c7-4e68-ad06-5c0deae18de3 service nova] Creating event network-changed:47450097-73fc-4399-a897-e58e8251e288 for instance 68b23633-8172-45b0-8ed7-1cd782ea603d on hv-cinder-85221 Sep 09 21:27:21.180195 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-5406e48c-7e64-4891-a044-ccdb9a7aa3a1 req-e98db68d-a4c7-4e68-ad06-5c0deae18de3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044703 Sep 09 21:27:21.180876 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 93/191] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:27:21.196204 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-459a546b-5e48-4a13-bf6b-9e7e8ef6bc49 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:21.197406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-459a546b-5e48-4a13-bf6b-9e7e8ef6bc49 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:21.207341 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-459a546b-5e48-4a13-bf6b-9e7e8ef6bc49 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:21.208403 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-459a546b-5e48-4a13-bf6b-9e7e8ef6bc49 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:21.208952 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-459a546b-5e48-4a13-bf6b-9e7e8ef6bc49 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:21.209718 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-459a546b-5e48-4a13-bf6b-9e7e8ef6bc49 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:21.210336 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-459a546b-5e48-4a13-bf6b-9e7e8ef6bc49 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:21.210832 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-459a546b-5e48-4a13-bf6b-9e7e8ef6bc49 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:21.218754 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1f33d205-2d81-48ce-a4df-94608a1c39ad tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:21.219698 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1f33d205-2d81-48ce-a4df-94608a1c39ad tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:21.227222 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f33d205-2d81-48ce-a4df-94608a1c39ad tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:21.227760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f33d205-2d81-48ce-a4df-94608a1c39ad tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:21.228209 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f33d205-2d81-48ce-a4df-94608a1c39ad tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:21.228910 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f33d205-2d81-48ce-a4df-94608a1c39ad tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:21.229403 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f33d205-2d81-48ce-a4df-94608a1c39ad tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:21.229834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f33d205-2d81-48ce-a4df-94608a1c39ad tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:21.430794 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-459a546b-5e48-4a13-bf6b-9e7e8ef6bc49 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:21.443900 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-459a546b-5e48-4a13-bf6b-9e7e8ef6bc49 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.252754 Sep 09 21:27:21.444994 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 99/192] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:21 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:21.594347 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1f33d205-2d81-48ce-a4df-94608a1c39ad tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:21.605725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1f33d205-2d81-48ce-a4df-94608a1c39ad tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1314 microversion: 2.1 time: 0.393874 Sep 09 21:27:21.606302 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 94/193] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:21 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:22.468672 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c3573261-505e-4c91-bba6-1599c66010cc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:22.469469 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c3573261-505e-4c91-bba6-1599c66010cc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:22.476607 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3573261-505e-4c91-bba6-1599c66010cc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:22.477577 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3573261-505e-4c91-bba6-1599c66010cc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:22.478025 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3573261-505e-4c91-bba6-1599c66010cc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:22.478746 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3573261-505e-4c91-bba6-1599c66010cc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:22.479210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3573261-505e-4c91-bba6-1599c66010cc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:22.479775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3573261-505e-4c91-bba6-1599c66010cc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:22.617842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c3573261-505e-4c91-bba6-1599c66010cc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:22.625943 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c3573261-505e-4c91-bba6-1599c66010cc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.160707 Sep 09 21:27:22.627262 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 100/194] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:22 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:22.640055 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3300262e-35c2-4ac3-8589-ed3608dfabbf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:22.640820 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3300262e-35c2-4ac3-8589-ed3608dfabbf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:22.647928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3300262e-35c2-4ac3-8589-ed3608dfabbf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:22.648419 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3300262e-35c2-4ac3-8589-ed3608dfabbf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:22.648888 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3300262e-35c2-4ac3-8589-ed3608dfabbf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:22.649581 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3300262e-35c2-4ac3-8589-ed3608dfabbf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:22.650033 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3300262e-35c2-4ac3-8589-ed3608dfabbf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:22.650460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3300262e-35c2-4ac3-8589-ed3608dfabbf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:22.784555 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-3300262e-35c2-4ac3-8589-ed3608dfabbf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:22.793345 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3300262e-35c2-4ac3-8589-ed3608dfabbf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1314 microversion: 2.1 time: 0.166538 Sep 09 21:27:22.793997 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 95/195] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:22 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:23.650136 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e3e2a371-63f5-486b-8000-acc2aafc93d4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:23.650757 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e3e2a371-63f5-486b-8000-acc2aafc93d4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:23.657140 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3e2a371-63f5-486b-8000-acc2aafc93d4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:23.657634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3e2a371-63f5-486b-8000-acc2aafc93d4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:23.658682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3e2a371-63f5-486b-8000-acc2aafc93d4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:23.659851 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3e2a371-63f5-486b-8000-acc2aafc93d4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:23.660316 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3e2a371-63f5-486b-8000-acc2aafc93d4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:23.660915 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3e2a371-63f5-486b-8000-acc2aafc93d4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:23.819089 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e3e2a371-63f5-486b-8000-acc2aafc93d4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:23.819494 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-47a72c08-82a9-4f04-8934-67805e9525d4 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:23.821394 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-47a72c08-82a9-4f04-8934-67805e9525d4 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:23.827764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e3e2a371-63f5-486b-8000-acc2aafc93d4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.181305 Sep 09 21:27:23.828723 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 101/196] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:23 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:23.829565 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-47a72c08-82a9-4f04-8934-67805e9525d4 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:23.831255 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-47a72c08-82a9-4f04-8934-67805e9525d4 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:23.832207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-47a72c08-82a9-4f04-8934-67805e9525d4 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:23.833101 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-47a72c08-82a9-4f04-8934-67805e9525d4 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:23.833688 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-47a72c08-82a9-4f04-8934-67805e9525d4 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:23.834416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-47a72c08-82a9-4f04-8934-67805e9525d4 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:23.852751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=100 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:24.012852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-47a72c08-82a9-4f04-8934-67805e9525d4 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:24.023963 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-47a72c08-82a9-4f04-8934-67805e9525d4 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1314 microversion: 2.1 time: 0.210950 Sep 09 21:27:24.024777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 96/197] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:23 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:24.868194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f15647e1-b7e5-43e8-a7e2-50dd792b7b70 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:24.868194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f15647e1-b7e5-43e8-a7e2-50dd792b7b70 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:24.868194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f15647e1-b7e5-43e8-a7e2-50dd792b7b70 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:24.870234 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f15647e1-b7e5-43e8-a7e2-50dd792b7b70 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:24.874404 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f15647e1-b7e5-43e8-a7e2-50dd792b7b70 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:24.874938 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f15647e1-b7e5-43e8-a7e2-50dd792b7b70 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:24.875493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f15647e1-b7e5-43e8-a7e2-50dd792b7b70 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:24.875870 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f15647e1-b7e5-43e8-a7e2-50dd792b7b70 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:25.019795 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f15647e1-b7e5-43e8-a7e2-50dd792b7b70 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:25.027471 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f15647e1-b7e5-43e8-a7e2-50dd792b7b70 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.173178 Sep 09 21:27:25.028052 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 102/198] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:24 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:25.049161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3da5b55b-d5f8-4631-b510-c58c7eaf67b0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:25.049994 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3da5b55b-d5f8-4631-b510-c58c7eaf67b0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:25.055895 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3da5b55b-d5f8-4631-b510-c58c7eaf67b0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:25.056385 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3da5b55b-d5f8-4631-b510-c58c7eaf67b0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:25.056797 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3da5b55b-d5f8-4631-b510-c58c7eaf67b0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:25.057503 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3da5b55b-d5f8-4631-b510-c58c7eaf67b0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:25.057931 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3da5b55b-d5f8-4631-b510-c58c7eaf67b0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:25.058344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3da5b55b-d5f8-4631-b510-c58c7eaf67b0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:25.233798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-3da5b55b-d5f8-4631-b510-c58c7eaf67b0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:25.243451 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3da5b55b-d5f8-4631-b510-c58c7eaf67b0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1314 microversion: 2.1 time: 0.198752 Sep 09 21:27:25.244559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 97/199] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:25 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:26.051048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f9c30323-a302-49b3-9056-b532f51f251e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:26.052130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f9c30323-a302-49b3-9056-b532f51f251e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:26.054106 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:26.054787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=8 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:26.075697 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9c30323-a302-49b3-9056-b532f51f251e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:26.075697 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9c30323-a302-49b3-9056-b532f51f251e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:26.076114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9c30323-a302-49b3-9056-b532f51f251e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:26.076821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9c30323-a302-49b3-9056-b532f51f251e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:26.077283 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9c30323-a302-49b3-9056-b532f51f251e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:26.077715 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9c30323-a302-49b3-9056-b532f51f251e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:26.082804 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:26.238884 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f9c30323-a302-49b3-9056-b532f51f251e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:26.246443 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f9c30323-a302-49b3-9056-b532f51f251e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.200288 Sep 09 21:27:26.247218 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 103/200] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:26 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:26.267351 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-99391fd5-d432-49d8-983f-808e16fcc4f6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:26.268086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-99391fd5-d432-49d8-983f-808e16fcc4f6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:26.273931 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-99391fd5-d432-49d8-983f-808e16fcc4f6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:26.274422 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-99391fd5-d432-49d8-983f-808e16fcc4f6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:26.274853 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-99391fd5-d432-49d8-983f-808e16fcc4f6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:26.275618 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-99391fd5-d432-49d8-983f-808e16fcc4f6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:26.276106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-99391fd5-d432-49d8-983f-808e16fcc4f6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:26.276530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-99391fd5-d432-49d8-983f-808e16fcc4f6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:26.415079 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-99391fd5-d432-49d8-983f-808e16fcc4f6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:26.423206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-99391fd5-d432-49d8-983f-808e16fcc4f6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1314 microversion: 2.1 time: 0.160993 Sep 09 21:27:26.423934 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 98/201] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:26 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:27.271743 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bedea882-0b3b-41fb-87d2-2d24d66110fa tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:27.272347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bedea882-0b3b-41fb-87d2-2d24d66110fa tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:27.278634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bedea882-0b3b-41fb-87d2-2d24d66110fa tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:27.279114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bedea882-0b3b-41fb-87d2-2d24d66110fa tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:27.279569 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bedea882-0b3b-41fb-87d2-2d24d66110fa tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:27.280259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bedea882-0b3b-41fb-87d2-2d24d66110fa tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:27.280709 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bedea882-0b3b-41fb-87d2-2d24d66110fa tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:27.281131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bedea882-0b3b-41fb-87d2-2d24d66110fa tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:27.414647 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bedea882-0b3b-41fb-87d2-2d24d66110fa tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:27.421613 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-49e7da32-4662-4f22-8e2c-439711aecebc req-6d7cb1c7-d58d-4adc-9cec-5095fae07a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b23633-8172-45b0-8ed7-1cd782ea603d", "name": "network-vif-plugged", "status": "completed", "tag": "47450097-73fc-4399-a897-e58e8251e288"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:27.424507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bedea882-0b3b-41fb-87d2-2d24d66110fa tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.156147 Sep 09 21:27:27.429574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 104/202] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:27 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:27.430248 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:27.434289 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-49e7da32-4662-4f22-8e2c-439711aecebc req-6d7cb1c7-d58d-4adc-9cec-5095fae07a4d service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:27.434984 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-49e7da32-4662-4f22-8e2c-439711aecebc req-6d7cb1c7-d58d-4adc-9cec-5095fae07a4d service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:27.436133 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-49e7da32-4662-4f22-8e2c-439711aecebc req-6d7cb1c7-d58d-4adc-9cec-5095fae07a4d service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:27.449232 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-51354bb1-f5ea-4b6e-b441-e7e4f5cc8e6c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:27.450415 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-51354bb1-f5ea-4b6e-b441-e7e4f5cc8e6c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:27.455273 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-49e7da32-4662-4f22-8e2c-439711aecebc req-6d7cb1c7-d58d-4adc-9cec-5095fae07a4d service nova] Creating event network-vif-plugged:47450097-73fc-4399-a897-e58e8251e288 for instance 68b23633-8172-45b0-8ed7-1cd782ea603d on hv-cinder-85221 Sep 09 21:27:27.457692 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-51354bb1-f5ea-4b6e-b441-e7e4f5cc8e6c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:27.459509 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-51354bb1-f5ea-4b6e-b441-e7e4f5cc8e6c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:27.460079 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-51354bb1-f5ea-4b6e-b441-e7e4f5cc8e6c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:27.460838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-49e7da32-4662-4f22-8e2c-439711aecebc req-6d7cb1c7-d58d-4adc-9cec-5095fae07a4d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043212 Sep 09 21:27:27.461433 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 99/203] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:27:27.461563 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-51354bb1-f5ea-4b6e-b441-e7e4f5cc8e6c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:27.462177 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-51354bb1-f5ea-4b6e-b441-e7e4f5cc8e6c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:27.462670 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-51354bb1-f5ea-4b6e-b441-e7e4f5cc8e6c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:27.602396 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-51354bb1-f5ea-4b6e-b441-e7e4f5cc8e6c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:27.622168 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-51354bb1-f5ea-4b6e-b441-e7e4f5cc8e6c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1314 microversion: 2.1 time: 0.177269 Sep 09 21:27:27.623432 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 105/204] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:27 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:28.450364 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1bebbd78-11d2-40d7-bc21-d63d068570e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:28.451093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1bebbd78-11d2-40d7-bc21-d63d068570e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:28.458256 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1bebbd78-11d2-40d7-bc21-d63d068570e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:28.458741 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1bebbd78-11d2-40d7-bc21-d63d068570e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:28.459174 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1bebbd78-11d2-40d7-bc21-d63d068570e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:28.459887 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1bebbd78-11d2-40d7-bc21-d63d068570e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:28.460344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1bebbd78-11d2-40d7-bc21-d63d068570e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:28.460771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1bebbd78-11d2-40d7-bc21-d63d068570e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:28.592617 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1bebbd78-11d2-40d7-bc21-d63d068570e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:28.600554 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1bebbd78-11d2-40d7-bc21-d63d068570e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.154509 Sep 09 21:27:28.601114 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 100/205] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:28 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:28.645525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-83d522fc-4348-46f6-b96a-6722c5827c06 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:28.646129 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-83d522fc-4348-46f6-b96a-6722c5827c06 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:28.648474 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:28.653678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83d522fc-4348-46f6-b96a-6722c5827c06 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:28.654157 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83d522fc-4348-46f6-b96a-6722c5827c06 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:28.654590 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83d522fc-4348-46f6-b96a-6722c5827c06 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:28.655270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83d522fc-4348-46f6-b96a-6722c5827c06 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:28.655763 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83d522fc-4348-46f6-b96a-6722c5827c06 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:28.656186 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83d522fc-4348-46f6-b96a-6722c5827c06 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:28.784687 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-83d522fc-4348-46f6-b96a-6722c5827c06 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:28.792184 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-83d522fc-4348-46f6-b96a-6722c5827c06 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1314 microversion: 2.1 time: 0.150928 Sep 09 21:27:28.792741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 106/206] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:28 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:29.627415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d4f202a6-f8ff-4801-840d-5900d26959c9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:29.628119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d4f202a6-f8ff-4801-840d-5900d26959c9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:29.634315 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4f202a6-f8ff-4801-840d-5900d26959c9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:29.634807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4f202a6-f8ff-4801-840d-5900d26959c9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:29.635247 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4f202a6-f8ff-4801-840d-5900d26959c9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:29.636040 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4f202a6-f8ff-4801-840d-5900d26959c9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:29.636441 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4f202a6-f8ff-4801-840d-5900d26959c9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:29.636852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4f202a6-f8ff-4801-840d-5900d26959c9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:29.782203 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d4f202a6-f8ff-4801-840d-5900d26959c9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:29.791999 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d4f202a6-f8ff-4801-840d-5900d26959c9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.169004 Sep 09 21:27:29.792645 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 101/207] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:29 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:29.814966 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-94260761-1fa8-4b05-b7f5-f02789b1a7e9 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:29.817880 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-94260761-1fa8-4b05-b7f5-f02789b1a7e9 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:29.825722 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-94260761-1fa8-4b05-b7f5-f02789b1a7e9 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:29.826390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-94260761-1fa8-4b05-b7f5-f02789b1a7e9 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:29.826828 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-94260761-1fa8-4b05-b7f5-f02789b1a7e9 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:29.827603 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-94260761-1fa8-4b05-b7f5-f02789b1a7e9 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:29.827998 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-94260761-1fa8-4b05-b7f5-f02789b1a7e9 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:29.828422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-94260761-1fa8-4b05-b7f5-f02789b1a7e9 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:29.970127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-94260761-1fa8-4b05-b7f5-f02789b1a7e9 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:29.978732 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-94260761-1fa8-4b05-b7f5-f02789b1a7e9 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1498 microversion: 2.1 time: 0.168581 Sep 09 21:27:29.979301 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 107/208] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:29 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1498 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:30.624916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e081ebc1-9c01-4ab8-ae47-e59d070ec220 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:30.625420 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e081ebc1-9c01-4ab8-ae47-e59d070ec220 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:30.632468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e081ebc1-9c01-4ab8-ae47-e59d070ec220 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:30.633025 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e081ebc1-9c01-4ab8-ae47-e59d070ec220 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:30.633523 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e081ebc1-9c01-4ab8-ae47-e59d070ec220 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:30.634098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e081ebc1-9c01-4ab8-ae47-e59d070ec220 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:30.634557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e081ebc1-9c01-4ab8-ae47-e59d070ec220 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:30.634987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e081ebc1-9c01-4ab8-ae47-e59d070ec220 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:30.665809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e081ebc1-9c01-4ab8-ae47-e59d070ec220 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:27:30.746042 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e081ebc1-9c01-4ab8-ae47-e59d070ec220 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "DELETE /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 204 len: 0 microversion: 2.1 time: 0.124617 Sep 09 21:27:30.746825 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 102/209] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:27:30 2022] DELETE /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:27:30.755954 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3cc296a1-02ac-404f-b721-80c5119a9267 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:30.756567 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3cc296a1-02ac-404f-b721-80c5119a9267 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:30.762432 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cc296a1-02ac-404f-b721-80c5119a9267 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:30.762916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cc296a1-02ac-404f-b721-80c5119a9267 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:30.763352 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cc296a1-02ac-404f-b721-80c5119a9267 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:30.764059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cc296a1-02ac-404f-b721-80c5119a9267 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:30.764512 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cc296a1-02ac-404f-b721-80c5119a9267 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:30.764937 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cc296a1-02ac-404f-b721-80c5119a9267 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:30.816892 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6d7e979f-a9e1-434a-a4aa-51ab007cfa31 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:30.817620 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6d7e979f-a9e1-434a-a4aa-51ab007cfa31 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:30.823551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6d7e979f-a9e1-434a-a4aa-51ab007cfa31 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:30.824057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6d7e979f-a9e1-434a-a4aa-51ab007cfa31 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:30.824511 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6d7e979f-a9e1-434a-a4aa-51ab007cfa31 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:30.825212 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6d7e979f-a9e1-434a-a4aa-51ab007cfa31 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:30.825668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6d7e979f-a9e1-434a-a4aa-51ab007cfa31 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:30.826236 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6d7e979f-a9e1-434a-a4aa-51ab007cfa31 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:30.903643 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3cc296a1-02ac-404f-b721-80c5119a9267 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:30.913725 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3cc296a1-02ac-404f-b721-80c5119a9267 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1504 microversion: 2.1 time: 0.162015 Sep 09 21:27:30.914390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 108/210] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:30 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:30.981726 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6d7e979f-a9e1-434a-a4aa-51ab007cfa31 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:30.989625 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6d7e979f-a9e1-434a-a4aa-51ab007cfa31 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.177638 Sep 09 21:27:30.990191 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 103/211] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:30 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:31.937469 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f9edfdef-c798-434f-b08b-6101a1971593 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:31.938164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f9edfdef-c798-434f-b08b-6101a1971593 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:31.944965 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9edfdef-c798-434f-b08b-6101a1971593 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:31.945590 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9edfdef-c798-434f-b08b-6101a1971593 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:31.946144 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9edfdef-c798-434f-b08b-6101a1971593 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:31.946979 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9edfdef-c798-434f-b08b-6101a1971593 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:31.947524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9edfdef-c798-434f-b08b-6101a1971593 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:31.948050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9edfdef-c798-434f-b08b-6101a1971593 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:32.012067 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-35c60855-5f66-4d6e-9842-99807751c4e4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:32.013553 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-35c60855-5f66-4d6e-9842-99807751c4e4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:32.020891 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35c60855-5f66-4d6e-9842-99807751c4e4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:32.021843 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35c60855-5f66-4d6e-9842-99807751c4e4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:32.022600 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35c60855-5f66-4d6e-9842-99807751c4e4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:32.023485 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35c60855-5f66-4d6e-9842-99807751c4e4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:32.023971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35c60855-5f66-4d6e-9842-99807751c4e4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:32.024396 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35c60855-5f66-4d6e-9842-99807751c4e4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:32.107846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f9edfdef-c798-434f-b08b-6101a1971593 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:32.116145 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f9edfdef-c798-434f-b08b-6101a1971593 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1504 microversion: 2.1 time: 0.182724 Sep 09 21:27:32.116712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 109/212] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:31 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:32.227631 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-35c60855-5f66-4d6e-9842-99807751c4e4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:32.239660 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-35c60855-5f66-4d6e-9842-99807751c4e4 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.231198 Sep 09 21:27:32.240622 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 104/213] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:32 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:33.130595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-05de764e-9761-4ec5-93b8-707880e05ce6 req-16f022ac-53b7-446d-9e46-365b41e43142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b23633-8172-45b0-8ed7-1cd782ea603d", "name": "network-vif-deleted", "tag": "47450097-73fc-4399-a897-e58e8251e288"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:33.139590 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9645fb36-f2ba-49da-af33-fcc11babc82d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:33.140469 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9645fb36-f2ba-49da-af33-fcc11babc82d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:33.144163 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-05de764e-9761-4ec5-93b8-707880e05ce6 req-16f022ac-53b7-446d-9e46-365b41e43142 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:33.144906 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-05de764e-9761-4ec5-93b8-707880e05ce6 req-16f022ac-53b7-446d-9e46-365b41e43142 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:33.145889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-05de764e-9761-4ec5-93b8-707880e05ce6 req-16f022ac-53b7-446d-9e46-365b41e43142 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:33.147960 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9645fb36-f2ba-49da-af33-fcc11babc82d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:33.148483 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9645fb36-f2ba-49da-af33-fcc11babc82d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:33.148918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9645fb36-f2ba-49da-af33-fcc11babc82d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:33.149783 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9645fb36-f2ba-49da-af33-fcc11babc82d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:33.150317 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9645fb36-f2ba-49da-af33-fcc11babc82d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:33.150800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9645fb36-f2ba-49da-af33-fcc11babc82d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:33.161339 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-05de764e-9761-4ec5-93b8-707880e05ce6 req-16f022ac-53b7-446d-9e46-365b41e43142 service nova] Creating event network-vif-deleted:47450097-73fc-4399-a897-e58e8251e288 for instance 68b23633-8172-45b0-8ed7-1cd782ea603d on hv-cinder-85221 Sep 09 21:27:33.166729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-05de764e-9761-4ec5-93b8-707880e05ce6 req-16f022ac-53b7-446d-9e46-365b41e43142 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040168 Sep 09 21:27:33.167614 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 110/214] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:27:33.236534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-9645fb36-f2ba-49da-af33-fcc11babc82d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:33.245667 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9645fb36-f2ba-49da-af33-fcc11babc82d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 200 len: 1462 microversion: 2.1 time: 0.110893 Sep 09 21:27:33.246361 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 105/215] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:33 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 1462 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:33.266252 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3c2caefd-059d-4581-886c-c0fadb385c01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:33.267877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3c2caefd-059d-4581-886c-c0fadb385c01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:33.275613 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c2caefd-059d-4581-886c-c0fadb385c01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:33.276114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c2caefd-059d-4581-886c-c0fadb385c01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:33.276570 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c2caefd-059d-4581-886c-c0fadb385c01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:33.277269 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c2caefd-059d-4581-886c-c0fadb385c01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:33.277752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c2caefd-059d-4581-886c-c0fadb385c01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:33.278165 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c2caefd-059d-4581-886c-c0fadb385c01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:33.454654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3c2caefd-059d-4581-886c-c0fadb385c01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:33.472702 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3c2caefd-059d-4581-886c-c0fadb385c01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.210445 Sep 09 21:27:33.473592 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 111/216] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:33 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:34.269785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:34.270431 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 68b23633-8172-45b0-8ed7-1cd782ea603d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:34.277976 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:34.278471 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:34.278910 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:34.280201 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:34.280669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:34.281099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:34.295146 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] HTTP exception thrown: Instance 68b23633-8172-45b0-8ed7-1cd782ea603d could not be found. Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Request method failure captured: Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d HTTP/1.1 Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG6-vFd1y2EC9Z24VGJr-iSyZSeyOoHd8zNh1nOY7aszTbjpBMoOcRZvMv7dKGTjENi3ZPdF-ANyGk1kWWUzYJeIXNf8n5ZaacjDwW5bM9b-upp4s-OYSExOUlj5WmSQmQsVSSKlA0UreIdWO45KC9E-FLLHC3ztdgfEUI7T-qsexUvo Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: bdf0d6145a4848a8bc624ded77bc27ac Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesActionsTest-1320004840 Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:27:34.296865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bdf0d6145a4848a8bc624ded77bc27ac", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdf0d6145a4848a8bc624ded77bc27ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdf0d6145a4848a8bc624ded77bc27ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bdf0d6145a4848a8bc624ded77bc27ac"}]}] Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesActionsTest-1320004840 Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: bdf0d6145a4848a8bc624ded77bc27ac Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesActionsTest-1320004840 Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesActionsTest-1320004840-project Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: ba45eee6687b45158555ef5f0c595680 Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesActionsTest-1320004840-project Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 68b23633-8172-45b0-8ed7-1cd782ea603d could not be found. Sep 09 21:27:34.298527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '68b23633-8172-45b0-8ed7-1cd782ea603d'} Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b23633-8172-45b0-8ed7-1cd782ea603d could not be found. Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:27:34.299766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b23633-8172-45b0-8ed7-1cd782ea603d could not be found. Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b23633-8172-45b0-8ed7-1cd782ea603d could not be found. Sep 09 21:27:34.301337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:27:34.302559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Returning 404 to user: Instance 68b23633-8172-45b0-8ed7-1cd782ea603d could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:27:34.302559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ec8f6e89-5683-4278-afc5-e36cae08cabe tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d" status: 404 len: 111 microversion: 2.1 time: 0.033476 Sep 09 21:27:34.302559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 106/217] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:34 2022] GET /compute/v2.1/servers/68b23633-8172-45b0-8ed7-1cd782ea603d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:27:34.400595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-424262687", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "networks": [{"uuid": "90ee32ed-1b7c-403a-9874-6aba33139ecf"}]}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:34.457592 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.network.neutron [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] validate_networks() for [('90ee32ed-1b7c-403a-9874-6aba33139ecf', None, None, None, None, None)] {{(pid=120465) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:27:34.498125 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9bf9cc01-d093-4641-bc6c-b82dc8b0fd98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:34.498728 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9bf9cc01-d093-4641-bc6c-b82dc8b0fd98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:34.504813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf9cc01-d093-4641-bc6c-b82dc8b0fd98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:34.505294 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf9cc01-d093-4641-bc6c-b82dc8b0fd98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:34.505726 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf9cc01-d093-4641-bc6c-b82dc8b0fd98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:34.506403 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf9cc01-d093-4641-bc6c-b82dc8b0fd98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:34.506852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf9cc01-d093-4641-bc6c-b82dc8b0fd98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:34.507274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf9cc01-d093-4641-bc6c-b82dc8b0fd98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:34.666916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-9bf9cc01-d093-4641-bc6c-b82dc8b0fd98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:34.680996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9bf9cc01-d093-4641-bc6c-b82dc8b0fd98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.186341 Sep 09 21:27:34.682202 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 107/218] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:34 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:34.822030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Flavor limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:27:34.822449 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Image limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:27:34.822918 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Flavor pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:27:34.823326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Image pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:27:34.823767 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:27:34.832482 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:34.832962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:34.833395 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:34.834117 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:34.834570 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:34.835044 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:34.851990 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Getting quotas for project bdf0d6145a4848a8bc624ded77bc27ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:27:34.855898 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Getting quotas for user ba45eee6687b45158555ef5f0c595680 and project bdf0d6145a4848a8bc624ded77bc27ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:27:34.867242 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Going to run 1 instances... {{(pid=120465) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:27:34.869522 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:27:34.917758 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ccf74f9e-bb16-49b2-ae84-e574673bc09d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520950 Sep 09 21:27:34.918391 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 112/219] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:27:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:27:34.942571 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-98de00a3-1e36-42d7-8c4b-322cbb7e14e2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:34.943187 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-98de00a3-1e36-42d7-8c4b-322cbb7e14e2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:34.998499 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-98de00a3-1e36-42d7-8c4b-322cbb7e14e2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:35.008024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-98de00a3-1e36-42d7-8c4b-322cbb7e14e2 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1213 microversion: 2.1 time: 0.082137 Sep 09 21:27:35.008904 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 108/220] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:34 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:35.708425 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-81aab67c-bfbc-488a-a0d4-3daf7f1c526f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:35.709124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-81aab67c-bfbc-488a-a0d4-3daf7f1c526f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:35.715028 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81aab67c-bfbc-488a-a0d4-3daf7f1c526f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:35.715586 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81aab67c-bfbc-488a-a0d4-3daf7f1c526f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:35.715965 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81aab67c-bfbc-488a-a0d4-3daf7f1c526f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:35.716645 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81aab67c-bfbc-488a-a0d4-3daf7f1c526f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:35.717097 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81aab67c-bfbc-488a-a0d4-3daf7f1c526f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:35.717546 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81aab67c-bfbc-488a-a0d4-3daf7f1c526f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:35.998306 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-81aab67c-bfbc-488a-a0d4-3daf7f1c526f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:36.021123 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-81aab67c-bfbc-488a-a0d4-3daf7f1c526f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.304624 Sep 09 21:27:36.021123 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 113/221] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:35 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:36.029896 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-397545bf-ec52-4f1c-9f1f-7d63537f6d0c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:36.030431 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-397545bf-ec52-4f1c-9f1f-7d63537f6d0c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:36.037297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-397545bf-ec52-4f1c-9f1f-7d63537f6d0c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:36.037788 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-397545bf-ec52-4f1c-9f1f-7d63537f6d0c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:36.038226 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-397545bf-ec52-4f1c-9f1f-7d63537f6d0c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:36.038921 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-397545bf-ec52-4f1c-9f1f-7d63537f6d0c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:36.039379 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-397545bf-ec52-4f1c-9f1f-7d63537f6d0c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:36.039845 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-397545bf-ec52-4f1c-9f1f-7d63537f6d0c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:36.114739 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-397545bf-ec52-4f1c-9f1f-7d63537f6d0c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:36.123265 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-397545bf-ec52-4f1c-9f1f-7d63537f6d0c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1265 microversion: 2.1 time: 0.097050 Sep 09 21:27:36.123862 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 109/222] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:36 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:37.030372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-25adc21e-bbe1-4ce0-95e3-8cb64284520e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:37.030980 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-25adc21e-bbe1-4ce0-95e3-8cb64284520e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:37.037632 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25adc21e-bbe1-4ce0-95e3-8cb64284520e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:37.038112 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25adc21e-bbe1-4ce0-95e3-8cb64284520e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:37.038544 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25adc21e-bbe1-4ce0-95e3-8cb64284520e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:37.039216 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25adc21e-bbe1-4ce0-95e3-8cb64284520e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:37.039694 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25adc21e-bbe1-4ce0-95e3-8cb64284520e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:37.040114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-25adc21e-bbe1-4ce0-95e3-8cb64284520e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:37.146992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-67f4310e-4def-4103-ab8d-069f34fe2620 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:37.147625 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-67f4310e-4def-4103-ab8d-069f34fe2620 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:37.153555 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67f4310e-4def-4103-ab8d-069f34fe2620 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:37.154037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67f4310e-4def-4103-ab8d-069f34fe2620 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:37.154469 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67f4310e-4def-4103-ab8d-069f34fe2620 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:37.155145 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67f4310e-4def-4103-ab8d-069f34fe2620 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:37.155727 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67f4310e-4def-4103-ab8d-069f34fe2620 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:37.156148 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67f4310e-4def-4103-ab8d-069f34fe2620 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:37.177574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-25adc21e-bbe1-4ce0-95e3-8cb64284520e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:37.185090 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-25adc21e-bbe1-4ce0-95e3-8cb64284520e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.158566 Sep 09 21:27:37.185651 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 114/223] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:37 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:37.217437 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-67f4310e-4def-4103-ab8d-069f34fe2620 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:37.225621 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-67f4310e-4def-4103-ab8d-069f34fe2620 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1265 microversion: 2.1 time: 0.082670 Sep 09 21:27:37.226177 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 110/224] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:37 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:38.208903 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0cccf392-177a-4991-9ff4-0312a98be518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:38.209536 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0cccf392-177a-4991-9ff4-0312a98be518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:38.215896 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0cccf392-177a-4991-9ff4-0312a98be518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:38.216375 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0cccf392-177a-4991-9ff4-0312a98be518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:38.216808 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0cccf392-177a-4991-9ff4-0312a98be518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:38.217487 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0cccf392-177a-4991-9ff4-0312a98be518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:38.217942 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0cccf392-177a-4991-9ff4-0312a98be518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:38.218368 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0cccf392-177a-4991-9ff4-0312a98be518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:38.248648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-bf81815b-c0ed-4eec-a1ce-309d8269022f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:38.249267 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-bf81815b-c0ed-4eec-a1ce-309d8269022f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:38.255931 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bf81815b-c0ed-4eec-a1ce-309d8269022f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:38.256426 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bf81815b-c0ed-4eec-a1ce-309d8269022f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:38.256864 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bf81815b-c0ed-4eec-a1ce-309d8269022f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:38.257557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bf81815b-c0ed-4eec-a1ce-309d8269022f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:38.258013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bf81815b-c0ed-4eec-a1ce-309d8269022f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:38.258442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bf81815b-c0ed-4eec-a1ce-309d8269022f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:38.328359 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-bf81815b-c0ed-4eec-a1ce-309d8269022f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:38.336015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-bf81815b-c0ed-4eec-a1ce-309d8269022f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1265 microversion: 2.1 time: 0.091099 Sep 09 21:27:38.336582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 111/225] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:38 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:38.352497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0cccf392-177a-4991-9ff4-0312a98be518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:38.360031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0cccf392-177a-4991-9ff4-0312a98be518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.155826 Sep 09 21:27:38.361135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 115/226] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:38 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:39.358780 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a65fe24e-8acd-416b-ba0e-3697b7f2bc5e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:39.359454 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a65fe24e-8acd-416b-ba0e-3697b7f2bc5e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:39.366078 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a65fe24e-8acd-416b-ba0e-3697b7f2bc5e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:39.366570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a65fe24e-8acd-416b-ba0e-3697b7f2bc5e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:39.367021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a65fe24e-8acd-416b-ba0e-3697b7f2bc5e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:39.367736 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a65fe24e-8acd-416b-ba0e-3697b7f2bc5e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:39.368198 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a65fe24e-8acd-416b-ba0e-3697b7f2bc5e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:39.368623 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a65fe24e-8acd-416b-ba0e-3697b7f2bc5e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:39.382752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d6366e35-f6b5-4fe6-b0e2-bc3defef1c00 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:39.383691 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d6366e35-f6b5-4fe6-b0e2-bc3defef1c00 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:39.390787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6366e35-f6b5-4fe6-b0e2-bc3defef1c00 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:39.391354 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6366e35-f6b5-4fe6-b0e2-bc3defef1c00 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:39.392505 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6366e35-f6b5-4fe6-b0e2-bc3defef1c00 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:39.393496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6366e35-f6b5-4fe6-b0e2-bc3defef1c00 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:39.394033 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6366e35-f6b5-4fe6-b0e2-bc3defef1c00 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:39.394525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6366e35-f6b5-4fe6-b0e2-bc3defef1c00 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:39.442835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a65fe24e-8acd-416b-ba0e-3697b7f2bc5e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:39.457342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a65fe24e-8acd-416b-ba0e-3697b7f2bc5e tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1265 microversion: 2.1 time: 0.102728 Sep 09 21:27:39.458477 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 112/227] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:39 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:39.551586 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d6366e35-f6b5-4fe6-b0e2-bc3defef1c00 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:39.559458 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d6366e35-f6b5-4fe6-b0e2-bc3defef1c00 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.180570 Sep 09 21:27:39.560056 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 116/228] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:39 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:40.481821 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-554466d4-195b-4aad-8e0f-53cc44f13a17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:40.482432 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-554466d4-195b-4aad-8e0f-53cc44f13a17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:40.489564 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-554466d4-195b-4aad-8e0f-53cc44f13a17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:40.490053 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-554466d4-195b-4aad-8e0f-53cc44f13a17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:40.490490 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-554466d4-195b-4aad-8e0f-53cc44f13a17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:40.491176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-554466d4-195b-4aad-8e0f-53cc44f13a17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:40.491694 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-554466d4-195b-4aad-8e0f-53cc44f13a17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:40.492466 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-554466d4-195b-4aad-8e0f-53cc44f13a17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:40.566050 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-554466d4-195b-4aad-8e0f-53cc44f13a17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:40.568325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:40.575833 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-554466d4-195b-4aad-8e0f-53cc44f13a17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1271 microversion: 2.1 time: 0.097821 Sep 09 21:27:40.576475 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 113/229] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:40 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:40.590247 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9b08c0f7-0c3f-4eb8-8a27-737717ea882d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:40.590864 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9b08c0f7-0c3f-4eb8-8a27-737717ea882d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:40.598331 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b08c0f7-0c3f-4eb8-8a27-737717ea882d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:40.598816 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b08c0f7-0c3f-4eb8-8a27-737717ea882d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:40.599256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b08c0f7-0c3f-4eb8-8a27-737717ea882d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:40.599985 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b08c0f7-0c3f-4eb8-8a27-737717ea882d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:40.600448 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b08c0f7-0c3f-4eb8-8a27-737717ea882d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:40.600879 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b08c0f7-0c3f-4eb8-8a27-737717ea882d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:40.755386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9b08c0f7-0c3f-4eb8-8a27-737717ea882d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:40.763043 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9b08c0f7-0c3f-4eb8-8a27-737717ea882d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.176781 Sep 09 21:27:40.763821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 117/230] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:40 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:41.460088 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-4d98fa5d-54b6-4e9c-93c3-033752c7bc5e req-64889f7b-0de0-4c00-b753-abc13f9eb1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e31e51-b8fd-4b97-a4d1-a5c515b8d72d", "tag": "62996df3-8340-425a-9c17-524f56c384d4"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:41.472394 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-4d98fa5d-54b6-4e9c-93c3-033752c7bc5e req-64889f7b-0de0-4c00-b753-abc13f9eb1c1 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:41.473173 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-4d98fa5d-54b6-4e9c-93c3-033752c7bc5e req-64889f7b-0de0-4c00-b753-abc13f9eb1c1 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:41.473946 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-4d98fa5d-54b6-4e9c-93c3-033752c7bc5e req-64889f7b-0de0-4c00-b753-abc13f9eb1c1 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:41.490052 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-4d98fa5d-54b6-4e9c-93c3-033752c7bc5e req-64889f7b-0de0-4c00-b753-abc13f9eb1c1 service nova] Creating event network-changed:62996df3-8340-425a-9c17-524f56c384d4 for instance 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d on hv-cinder-85221 Sep 09 21:27:41.495399 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-4d98fa5d-54b6-4e9c-93c3-033752c7bc5e req-64889f7b-0de0-4c00-b753-abc13f9eb1c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040920 Sep 09 21:27:41.496032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 114/231] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:27:41.600204 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b3f2064c-5a3f-45be-ba80-448d494700c0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:41.601082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b3f2064c-5a3f-45be-ba80-448d494700c0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:41.609285 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3f2064c-5a3f-45be-ba80-448d494700c0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:41.609726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3f2064c-5a3f-45be-ba80-448d494700c0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:41.610330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3f2064c-5a3f-45be-ba80-448d494700c0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:41.611753 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3f2064c-5a3f-45be-ba80-448d494700c0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:41.612207 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3f2064c-5a3f-45be-ba80-448d494700c0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:41.612629 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3f2064c-5a3f-45be-ba80-448d494700c0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:41.790438 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1fc75937-ae50-490f-b133-1a4066f10e54 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:41.791249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1fc75937-ae50-490f-b133-1a4066f10e54 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:41.792501 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b3f2064c-5a3f-45be-ba80-448d494700c0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:41.799336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fc75937-ae50-490f-b133-1a4066f10e54 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:41.799935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fc75937-ae50-490f-b133-1a4066f10e54 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:41.800591 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fc75937-ae50-490f-b133-1a4066f10e54 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:41.801291 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fc75937-ae50-490f-b133-1a4066f10e54 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:41.802023 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fc75937-ae50-490f-b133-1a4066f10e54 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:41.802452 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fc75937-ae50-490f-b133-1a4066f10e54 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:41.802672 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b3f2064c-5a3f-45be-ba80-448d494700c0 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.206898 Sep 09 21:27:41.803415 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 118/232] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:41 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:42.025987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1fc75937-ae50-490f-b133-1a4066f10e54 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:42.034705 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1fc75937-ae50-490f-b133-1a4066f10e54 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.251900 Sep 09 21:27:42.035282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 115/233] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:41 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:42.824218 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5d8b2d9b-7ef8-437e-8252-acdc59ac620c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:42.824834 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5d8b2d9b-7ef8-437e-8252-acdc59ac620c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:42.831504 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5d8b2d9b-7ef8-437e-8252-acdc59ac620c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:42.832023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5d8b2d9b-7ef8-437e-8252-acdc59ac620c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:42.832465 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5d8b2d9b-7ef8-437e-8252-acdc59ac620c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:42.833151 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5d8b2d9b-7ef8-437e-8252-acdc59ac620c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:42.833616 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5d8b2d9b-7ef8-437e-8252-acdc59ac620c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:42.834042 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5d8b2d9b-7ef8-437e-8252-acdc59ac620c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:42.961296 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-5d8b2d9b-7ef8-437e-8252-acdc59ac620c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:42.969118 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5d8b2d9b-7ef8-437e-8252-acdc59ac620c tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.148704 Sep 09 21:27:42.969774 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 119/234] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:42 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:43.057851 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-34ac82d5-feb9-4cb1-a1c2-ae61bdb09f19 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:43.058543 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-34ac82d5-feb9-4cb1-a1c2-ae61bdb09f19 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:43.065037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34ac82d5-feb9-4cb1-a1c2-ae61bdb09f19 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:43.065519 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34ac82d5-feb9-4cb1-a1c2-ae61bdb09f19 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:43.065958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34ac82d5-feb9-4cb1-a1c2-ae61bdb09f19 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:43.066646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34ac82d5-feb9-4cb1-a1c2-ae61bdb09f19 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:43.067136 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34ac82d5-feb9-4cb1-a1c2-ae61bdb09f19 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:43.067578 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-34ac82d5-feb9-4cb1-a1c2-ae61bdb09f19 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:43.414504 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-34ac82d5-feb9-4cb1-a1c2-ae61bdb09f19 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:43.422073 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-34ac82d5-feb9-4cb1-a1c2-ae61bdb09f19 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.367977 Sep 09 21:27:43.422624 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 116/235] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:43 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:43.992634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5058c34c-58ba-426d-acd0-f5550216c980 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:43.993253 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5058c34c-58ba-426d-acd0-f5550216c980 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:43.999703 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5058c34c-58ba-426d-acd0-f5550216c980 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:44.000191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5058c34c-58ba-426d-acd0-f5550216c980 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:44.000630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5058c34c-58ba-426d-acd0-f5550216c980 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:44.001935 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5058c34c-58ba-426d-acd0-f5550216c980 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:44.002402 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5058c34c-58ba-426d-acd0-f5550216c980 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:44.002831 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5058c34c-58ba-426d-acd0-f5550216c980 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:44.133823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-5058c34c-58ba-426d-acd0-f5550216c980 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:44.141353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5058c34c-58ba-426d-acd0-f5550216c980 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.152628 Sep 09 21:27:44.142906 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 120/236] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:43 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:27:44.445513 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1dfe0761-0691-4ce4-b36d-7f6d139751a0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:44.446117 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1dfe0761-0691-4ce4-b36d-7f6d139751a0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:44.452017 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1dfe0761-0691-4ce4-b36d-7f6d139751a0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:44.452492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1dfe0761-0691-4ce4-b36d-7f6d139751a0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:44.452922 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1dfe0761-0691-4ce4-b36d-7f6d139751a0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:44.453596 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1dfe0761-0691-4ce4-b36d-7f6d139751a0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:44.454580 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1dfe0761-0691-4ce4-b36d-7f6d139751a0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:44.455061 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1dfe0761-0691-4ce4-b36d-7f6d139751a0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:44.580700 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1dfe0761-0691-4ce4-b36d-7f6d139751a0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:44.588231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1dfe0761-0691-4ce4-b36d-7f6d139751a0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.146548 Sep 09 21:27:44.588778 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 117/237] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:44 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:45.165889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0b1f078c-6e0f-42db-b0c4-677850567277 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:45.166498 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0b1f078c-6e0f-42db-b0c4-677850567277 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:45.168464 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:45.169300 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=6 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:45.175755 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b1f078c-6e0f-42db-b0c4-677850567277 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:45.176245 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b1f078c-6e0f-42db-b0c4-677850567277 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:45.176683 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b1f078c-6e0f-42db-b0c4-677850567277 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:45.177372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b1f078c-6e0f-42db-b0c4-677850567277 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:45.177832 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b1f078c-6e0f-42db-b0c4-677850567277 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:45.178259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b1f078c-6e0f-42db-b0c4-677850567277 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:45.182545 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=100 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:45.308950 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0b1f078c-6e0f-42db-b0c4-677850567277 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:45.317533 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0b1f078c-6e0f-42db-b0c4-677850567277 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.155432 Sep 09 21:27:45.318103 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 121/238] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:45 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:45.611502 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-cf40111c-c342-4248-8794-4b962a6e2ce7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:45.612083 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-cf40111c-c342-4248-8794-4b962a6e2ce7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:45.613983 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:45.619618 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf40111c-c342-4248-8794-4b962a6e2ce7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:45.620116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf40111c-c342-4248-8794-4b962a6e2ce7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:45.620557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf40111c-c342-4248-8794-4b962a6e2ce7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:45.621251 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf40111c-c342-4248-8794-4b962a6e2ce7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:45.621742 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf40111c-c342-4248-8794-4b962a6e2ce7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:45.622171 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf40111c-c342-4248-8794-4b962a6e2ce7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:45.753124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-cf40111c-c342-4248-8794-4b962a6e2ce7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:45.760747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-cf40111c-c342-4248-8794-4b962a6e2ce7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.153178 Sep 09 21:27:45.761308 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 118/239] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:45 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:46.340713 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-826922c6-2932-497f-a52a-722b999241bf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:46.341830 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-826922c6-2932-497f-a52a-722b999241bf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:46.348521 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-826922c6-2932-497f-a52a-722b999241bf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:46.349003 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-826922c6-2932-497f-a52a-722b999241bf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:46.349438 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-826922c6-2932-497f-a52a-722b999241bf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:46.350127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-826922c6-2932-497f-a52a-722b999241bf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:46.350589 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-826922c6-2932-497f-a52a-722b999241bf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:46.351005 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-826922c6-2932-497f-a52a-722b999241bf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:46.481502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-826922c6-2932-497f-a52a-722b999241bf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:46.489441 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-826922c6-2932-497f-a52a-722b999241bf tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.152579 Sep 09 21:27:46.489998 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 122/240] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:46 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:46.783609 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-cc5cc072-a62b-4903-97a5-73a2e4a7dcd0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:46.784601 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-cc5cc072-a62b-4903-97a5-73a2e4a7dcd0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:46.790521 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc5cc072-a62b-4903-97a5-73a2e4a7dcd0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:46.791009 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc5cc072-a62b-4903-97a5-73a2e4a7dcd0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:46.791449 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc5cc072-a62b-4903-97a5-73a2e4a7dcd0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:46.792174 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc5cc072-a62b-4903-97a5-73a2e4a7dcd0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:46.792631 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc5cc072-a62b-4903-97a5-73a2e4a7dcd0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:46.793063 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc5cc072-a62b-4903-97a5-73a2e4a7dcd0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:46.925156 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-cc5cc072-a62b-4903-97a5-73a2e4a7dcd0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:46.932784 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-cc5cc072-a62b-4903-97a5-73a2e4a7dcd0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.153206 Sep 09 21:27:46.933344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 119/241] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:46 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:47.513844 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-cae110f9-a848-402a-b9e1-c254f09f4759 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:47.514736 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-cae110f9-a848-402a-b9e1-c254f09f4759 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:47.521833 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cae110f9-a848-402a-b9e1-c254f09f4759 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:47.522642 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cae110f9-a848-402a-b9e1-c254f09f4759 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:47.523192 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cae110f9-a848-402a-b9e1-c254f09f4759 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:47.524021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cae110f9-a848-402a-b9e1-c254f09f4759 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:47.524696 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cae110f9-a848-402a-b9e1-c254f09f4759 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:47.525221 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cae110f9-a848-402a-b9e1-c254f09f4759 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:47.675290 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-cae110f9-a848-402a-b9e1-c254f09f4759 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:47.683095 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-cae110f9-a848-402a-b9e1-c254f09f4759 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.174859 Sep 09 21:27:47.683877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 123/242] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:47 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:47.957444 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3687d9fe-f606-4535-9c73-e0a2b0cc8cb9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:47.958057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3687d9fe-f606-4535-9c73-e0a2b0cc8cb9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:47.963894 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3687d9fe-f606-4535-9c73-e0a2b0cc8cb9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:47.964386 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3687d9fe-f606-4535-9c73-e0a2b0cc8cb9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:47.964826 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3687d9fe-f606-4535-9c73-e0a2b0cc8cb9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:47.965513 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3687d9fe-f606-4535-9c73-e0a2b0cc8cb9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:47.965971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3687d9fe-f606-4535-9c73-e0a2b0cc8cb9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:47.966399 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3687d9fe-f606-4535-9c73-e0a2b0cc8cb9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:48.102991 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-3687d9fe-f606-4535-9c73-e0a2b0cc8cb9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:48.112379 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3687d9fe-f606-4535-9c73-e0a2b0cc8cb9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.158971 Sep 09 21:27:48.112950 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 120/243] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:47 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:48.713904 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a65e3edd-87c9-4cf6-be8d-a7d1f6b66e40 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:48.733457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a65e3edd-87c9-4cf6-be8d-a7d1f6b66e40 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:48.742210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a65e3edd-87c9-4cf6-be8d-a7d1f6b66e40 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:48.745157 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a65e3edd-87c9-4cf6-be8d-a7d1f6b66e40 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:48.745958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a65e3edd-87c9-4cf6-be8d-a7d1f6b66e40 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:48.746747 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a65e3edd-87c9-4cf6-be8d-a7d1f6b66e40 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:48.747334 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a65e3edd-87c9-4cf6-be8d-a7d1f6b66e40 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:48.747841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a65e3edd-87c9-4cf6-be8d-a7d1f6b66e40 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:49.015769 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a65e3edd-87c9-4cf6-be8d-a7d1f6b66e40 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:49.026271 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a65e3edd-87c9-4cf6-be8d-a7d1f6b66e40 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.323621 Sep 09 21:27:49.026864 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 124/244] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:48 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:49.135803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-572f13d1-035f-4013-b6c0-777843b1a572 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:49.136470 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-572f13d1-035f-4013-b6c0-777843b1a572 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:49.143265 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-572f13d1-035f-4013-b6c0-777843b1a572 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:49.143787 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-572f13d1-035f-4013-b6c0-777843b1a572 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:49.144232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-572f13d1-035f-4013-b6c0-777843b1a572 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:49.144926 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-572f13d1-035f-4013-b6c0-777843b1a572 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:49.145388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-572f13d1-035f-4013-b6c0-777843b1a572 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:49.145820 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-572f13d1-035f-4013-b6c0-777843b1a572 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:49.472692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-572f13d1-035f-4013-b6c0-777843b1a572 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:49.481070 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-572f13d1-035f-4013-b6c0-777843b1a572 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.349161 Sep 09 21:27:49.481647 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 121/245] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:49 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:50.052555 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-550f0d12-6f6a-4d62-b559-2e28e7a66a38 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:50.053341 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-550f0d12-6f6a-4d62-b559-2e28e7a66a38 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:50.060505 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-550f0d12-6f6a-4d62-b559-2e28e7a66a38 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:50.061183 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-550f0d12-6f6a-4d62-b559-2e28e7a66a38 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:50.062103 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-550f0d12-6f6a-4d62-b559-2e28e7a66a38 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:50.063106 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-550f0d12-6f6a-4d62-b559-2e28e7a66a38 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:50.064336 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-550f0d12-6f6a-4d62-b559-2e28e7a66a38 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:50.064996 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-550f0d12-6f6a-4d62-b559-2e28e7a66a38 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:50.281851 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-550f0d12-6f6a-4d62-b559-2e28e7a66a38 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:50.291776 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-550f0d12-6f6a-4d62-b559-2e28e7a66a38 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.243569 Sep 09 21:27:50.303850 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 125/246] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:50 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:50.513902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d0751155-5981-47c4-b797-a2f712bba80b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:50.514548 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d0751155-5981-47c4-b797-a2f712bba80b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:50.530472 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0751155-5981-47c4-b797-a2f712bba80b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:50.530960 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0751155-5981-47c4-b797-a2f712bba80b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:50.531499 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0751155-5981-47c4-b797-a2f712bba80b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:50.532323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0751155-5981-47c4-b797-a2f712bba80b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:50.532933 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0751155-5981-47c4-b797-a2f712bba80b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:50.533363 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d0751155-5981-47c4-b797-a2f712bba80b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:50.700910 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d0751155-5981-47c4-b797-a2f712bba80b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:50.710231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d0751155-5981-47c4-b797-a2f712bba80b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.209088 Sep 09 21:27:50.722321 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 122/247] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:50 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:51.317979 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e4766185-efba-40e9-b6dd-e91e2f9fde9f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:51.318641 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e4766185-efba-40e9-b6dd-e91e2f9fde9f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:51.325032 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4766185-efba-40e9-b6dd-e91e2f9fde9f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:51.325866 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4766185-efba-40e9-b6dd-e91e2f9fde9f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:51.326459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4766185-efba-40e9-b6dd-e91e2f9fde9f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:51.327319 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4766185-efba-40e9-b6dd-e91e2f9fde9f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:51.328139 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4766185-efba-40e9-b6dd-e91e2f9fde9f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:51.328886 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4766185-efba-40e9-b6dd-e91e2f9fde9f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:51.563738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e4766185-efba-40e9-b6dd-e91e2f9fde9f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:51.571905 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e4766185-efba-40e9-b6dd-e91e2f9fde9f tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.260105 Sep 09 21:27:51.572708 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 126/248] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:51 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:51.736302 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8f9279b5-e78c-4b7b-a588-18aa482c0df1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:51.737562 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8f9279b5-e78c-4b7b-a588-18aa482c0df1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:51.744019 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8f9279b5-e78c-4b7b-a588-18aa482c0df1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:51.744826 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8f9279b5-e78c-4b7b-a588-18aa482c0df1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:51.745260 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8f9279b5-e78c-4b7b-a588-18aa482c0df1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:51.746025 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8f9279b5-e78c-4b7b-a588-18aa482c0df1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:51.746737 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8f9279b5-e78c-4b7b-a588-18aa482c0df1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:51.747164 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8f9279b5-e78c-4b7b-a588-18aa482c0df1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:51.973576 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8f9279b5-e78c-4b7b-a588-18aa482c0df1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:51.988875 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8f9279b5-e78c-4b7b-a588-18aa482c0df1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1522 microversion: 2.1 time: 0.256598 Sep 09 21:27:52.002058 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 123/249] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:51 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:52.492624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-1ccc70c2-b5f9-4606-ba0c-df04e2d0b391 req-cc7e11be-93d2-4e5f-8138-f1b7e061b3af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e31e51-b8fd-4b97-a4d1-a5c515b8d72d", "name": "network-vif-plugged", "status": "completed", "tag": "62996df3-8340-425a-9c17-524f56c384d4"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:52.505420 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-1ccc70c2-b5f9-4606-ba0c-df04e2d0b391 req-cc7e11be-93d2-4e5f-8138-f1b7e061b3af service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:52.506806 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-1ccc70c2-b5f9-4606-ba0c-df04e2d0b391 req-cc7e11be-93d2-4e5f-8138-f1b7e061b3af service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:52.507794 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-1ccc70c2-b5f9-4606-ba0c-df04e2d0b391 req-cc7e11be-93d2-4e5f-8138-f1b7e061b3af service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:52.524375 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-1ccc70c2-b5f9-4606-ba0c-df04e2d0b391 req-cc7e11be-93d2-4e5f-8138-f1b7e061b3af service nova] Creating event network-vif-plugged:62996df3-8340-425a-9c17-524f56c384d4 for instance 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d on hv-cinder-85221 Sep 09 21:27:52.530896 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-1ccc70c2-b5f9-4606-ba0c-df04e2d0b391 req-cc7e11be-93d2-4e5f-8138-f1b7e061b3af service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042271 Sep 09 21:27:52.533075 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 127/250] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:27:52.594914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-086c435b-9e37-4d2b-9026-964d95e0e24d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:52.596375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-086c435b-9e37-4d2b-9026-964d95e0e24d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:52.614098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086c435b-9e37-4d2b-9026-964d95e0e24d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:52.614736 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086c435b-9e37-4d2b-9026-964d95e0e24d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:52.615180 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086c435b-9e37-4d2b-9026-964d95e0e24d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:52.616614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086c435b-9e37-4d2b-9026-964d95e0e24d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:52.617103 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086c435b-9e37-4d2b-9026-964d95e0e24d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:52.617533 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-086c435b-9e37-4d2b-9026-964d95e0e24d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:52.929765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-086c435b-9e37-4d2b-9026-964d95e0e24d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:52.939902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-086c435b-9e37-4d2b-9026-964d95e0e24d tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.349196 Sep 09 21:27:52.940335 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 124/251] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:52 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:53.015372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e5b123db-4b38-4428-be55-ab58e8263e90 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:53.020973 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e5b123db-4b38-4428-be55-ab58e8263e90 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:53.027181 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5b123db-4b38-4428-be55-ab58e8263e90 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:53.027704 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5b123db-4b38-4428-be55-ab58e8263e90 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:53.028146 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5b123db-4b38-4428-be55-ab58e8263e90 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:53.028846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5b123db-4b38-4428-be55-ab58e8263e90 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:53.029305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5b123db-4b38-4428-be55-ab58e8263e90 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:53.029737 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5b123db-4b38-4428-be55-ab58e8263e90 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:53.226088 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e5b123db-4b38-4428-be55-ab58e8263e90 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:53.239471 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e5b123db-4b38-4428-be55-ab58e8263e90 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1502 microversion: 2.1 time: 0.228828 Sep 09 21:27:53.241005 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 128/252] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:53 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:53.262525 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c1853a2e-04d4-43af-9596-82e5e57e6663 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:53.263136 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c1853a2e-04d4-43af-9596-82e5e57e6663 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:53.273082 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c1853a2e-04d4-43af-9596-82e5e57e6663 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:53.273854 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c1853a2e-04d4-43af-9596-82e5e57e6663 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:53.274465 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c1853a2e-04d4-43af-9596-82e5e57e6663 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:53.275678 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c1853a2e-04d4-43af-9596-82e5e57e6663 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:53.276358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c1853a2e-04d4-43af-9596-82e5e57e6663 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:53.277350 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c1853a2e-04d4-43af-9596-82e5e57e6663 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:53.823478 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c1853a2e-04d4-43af-9596-82e5e57e6663 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:53.833482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c1853a2e-04d4-43af-9596-82e5e57e6663 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1516 microversion: 2.1 time: 0.575001 Sep 09 21:27:53.834869 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 125/253] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:53 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1516 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:53.962126 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-49785167-0cd8-4d82-a455-27bec6cfd505 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:53.963675 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-49785167-0cd8-4d82-a455-27bec6cfd505 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:53.973683 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-49785167-0cd8-4d82-a455-27bec6cfd505 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:53.974398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-49785167-0cd8-4d82-a455-27bec6cfd505 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:53.974936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-49785167-0cd8-4d82-a455-27bec6cfd505 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:53.975848 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-49785167-0cd8-4d82-a455-27bec6cfd505 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:53.976467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-49785167-0cd8-4d82-a455-27bec6cfd505 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:53.977055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-49785167-0cd8-4d82-a455-27bec6cfd505 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:54.253049 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-49785167-0cd8-4d82-a455-27bec6cfd505 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:54.270874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-49785167-0cd8-4d82-a455-27bec6cfd505 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.312456 Sep 09 21:27:54.279688 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 129/254] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:53 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:55.299919 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-80f43430-148c-4060-9719-0c4891e192c5 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:55.301177 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-80f43430-148c-4060-9719-0c4891e192c5 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:55.307777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80f43430-148c-4060-9719-0c4891e192c5 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:55.308568 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80f43430-148c-4060-9719-0c4891e192c5 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:55.309011 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80f43430-148c-4060-9719-0c4891e192c5 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:55.309953 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80f43430-148c-4060-9719-0c4891e192c5 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:55.310845 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80f43430-148c-4060-9719-0c4891e192c5 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:55.312470 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80f43430-148c-4060-9719-0c4891e192c5 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:55.435014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-750e032d-77f8-473b-8e07-3c3050147eb7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:27:55.437257 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-750e032d-77f8-473b-8e07-3c3050147eb7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:55.444279 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-750e032d-77f8-473b-8e07-3c3050147eb7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:55.444774 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-750e032d-77f8-473b-8e07-3c3050147eb7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:55.445214 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-750e032d-77f8-473b-8e07-3c3050147eb7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:55.445920 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-750e032d-77f8-473b-8e07-3c3050147eb7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:55.446604 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-750e032d-77f8-473b-8e07-3c3050147eb7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:55.447042 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-750e032d-77f8-473b-8e07-3c3050147eb7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:55.477628 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-750e032d-77f8-473b-8e07-3c3050147eb7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lazy-loading 'flavor' on Instance uuid 5eedc741-6d4f-4cbd-9a25-a712414a9bbe {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:27:55.558080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-750e032d-77f8-473b-8e07-3c3050147eb7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe/action" status: 200 len: 32 microversion: 2.1 time: 0.127021 Sep 09 21:27:55.559122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 130/255] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:27:55 2022] POST /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:27:55.567063 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-80f43430-148c-4060-9719-0c4891e192c5 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:55.570802 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-37f36fa3-070b-4593-b6ba-3770655a353e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:55.571746 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-37f36fa3-070b-4593-b6ba-3770655a353e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:55.587344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-80f43430-148c-4060-9719-0c4891e192c5 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1313 microversion: 2.1 time: 0.291735 Sep 09 21:27:55.588362 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-37f36fa3-070b-4593-b6ba-3770655a353e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:55.588761 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 126/256] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:55 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:55.588919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-37f36fa3-070b-4593-b6ba-3770655a353e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:55.589636 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-37f36fa3-070b-4593-b6ba-3770655a353e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:55.589985 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-37f36fa3-070b-4593-b6ba-3770655a353e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:55.590514 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-37f36fa3-070b-4593-b6ba-3770655a353e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:55.590870 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-37f36fa3-070b-4593-b6ba-3770655a353e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:55.796671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-37f36fa3-070b-4593-b6ba-3770655a353e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:55.805720 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-37f36fa3-070b-4593-b6ba-3770655a353e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.239452 Sep 09 21:27:55.806567 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 131/257] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:55 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:56.614066 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f4187b1d-28e4-41c1-9cef-6300663100f3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:56.615686 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f4187b1d-28e4-41c1-9cef-6300663100f3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:56.627995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f4187b1d-28e4-41c1-9cef-6300663100f3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:56.628616 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f4187b1d-28e4-41c1-9cef-6300663100f3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:56.629184 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f4187b1d-28e4-41c1-9cef-6300663100f3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:56.630003 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f4187b1d-28e4-41c1-9cef-6300663100f3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:56.634843 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f4187b1d-28e4-41c1-9cef-6300663100f3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:56.635677 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f4187b1d-28e4-41c1-9cef-6300663100f3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:56.841519 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3cde7457-8b1a-41d1-8c50-67d72e5b687e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:56.842303 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3cde7457-8b1a-41d1-8c50-67d72e5b687e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:56.852510 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cde7457-8b1a-41d1-8c50-67d72e5b687e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:56.853003 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cde7457-8b1a-41d1-8c50-67d72e5b687e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:56.853627 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cde7457-8b1a-41d1-8c50-67d72e5b687e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:56.854492 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cde7457-8b1a-41d1-8c50-67d72e5b687e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:56.855101 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cde7457-8b1a-41d1-8c50-67d72e5b687e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:56.856044 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3cde7457-8b1a-41d1-8c50-67d72e5b687e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:57.057310 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f4187b1d-28e4-41c1-9cef-6300663100f3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:57.070352 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f4187b1d-28e4-41c1-9cef-6300663100f3 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1497 microversion: 2.1 time: 0.461277 Sep 09 21:27:57.071685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 127/258] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:56 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1497 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:57.092212 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3cde7457-8b1a-41d1-8c50-67d72e5b687e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:57.113423 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3cde7457-8b1a-41d1-8c50-67d72e5b687e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.285990 Sep 09 21:27:57.116017 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 132/259] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:56 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:57.854191 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-11bf9113-3e5f-485d-8911-c7e7c0a307b6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:57.854771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-11bf9113-3e5f-485d-8911-c7e7c0a307b6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:57.857501 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:57.866704 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11bf9113-3e5f-485d-8911-c7e7c0a307b6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:57.871397 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11bf9113-3e5f-485d-8911-c7e7c0a307b6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:57.871908 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11bf9113-3e5f-485d-8911-c7e7c0a307b6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:57.872930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11bf9113-3e5f-485d-8911-c7e7c0a307b6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:57.873626 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11bf9113-3e5f-485d-8911-c7e7c0a307b6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:57.874057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11bf9113-3e5f-485d-8911-c7e7c0a307b6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:57.927787 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-11bf9113-3e5f-485d-8911-c7e7c0a307b6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:27:58.034026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-11bf9113-3e5f-485d-8911-c7e7c0a307b6 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "DELETE /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 204 len: 0 microversion: 2.1 time: 0.183645 Sep 09 21:27:58.036255 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 128/260] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:27:57 2022] DELETE /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:27:58.046135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-92bf10c8-a7b7-448f-968f-9ed752b27d17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:58.046843 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-92bf10c8-a7b7-448f-968f-9ed752b27d17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:58.056964 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-92bf10c8-a7b7-448f-968f-9ed752b27d17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:58.060092 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-92bf10c8-a7b7-448f-968f-9ed752b27d17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:58.060549 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-92bf10c8-a7b7-448f-968f-9ed752b27d17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:58.061291 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-92bf10c8-a7b7-448f-968f-9ed752b27d17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:58.061760 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-92bf10c8-a7b7-448f-968f-9ed752b27d17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:58.062189 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-92bf10c8-a7b7-448f-968f-9ed752b27d17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:58.140964 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6e78c8e8-86e7-4cdc-bd94-923787bd938c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:58.142684 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6e78c8e8-86e7-4cdc-bd94-923787bd938c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:58.162015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6e78c8e8-86e7-4cdc-bd94-923787bd938c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:58.163134 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6e78c8e8-86e7-4cdc-bd94-923787bd938c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:58.164325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6e78c8e8-86e7-4cdc-bd94-923787bd938c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:58.166524 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6e78c8e8-86e7-4cdc-bd94-923787bd938c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:58.169348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6e78c8e8-86e7-4cdc-bd94-923787bd938c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:58.171063 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6e78c8e8-86e7-4cdc-bd94-923787bd938c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:58.260221 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:58.358326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-92bf10c8-a7b7-448f-968f-9ed752b27d17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:58.369587 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-92bf10c8-a7b7-448f-968f-9ed752b27d17 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1503 microversion: 2.1 time: 0.329019 Sep 09 21:27:58.370590 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 133/261] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:58 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:58.476714 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6e78c8e8-86e7-4cdc-bd94-923787bd938c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:58.487071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6e78c8e8-86e7-4cdc-bd94-923787bd938c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.352024 Sep 09 21:27:58.487662 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 129/262] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:58 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:59.399510 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-53af3170-9a3b-49b0-971e-4543c5160088 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:59.400547 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-53af3170-9a3b-49b0-971e-4543c5160088 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:59.409507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:27:59.412373 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53af3170-9a3b-49b0-971e-4543c5160088 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:59.413331 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53af3170-9a3b-49b0-971e-4543c5160088 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:59.414074 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53af3170-9a3b-49b0-971e-4543c5160088 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:59.415112 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53af3170-9a3b-49b0-971e-4543c5160088 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:59.415738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53af3170-9a3b-49b0-971e-4543c5160088 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:59.416173 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53af3170-9a3b-49b0-971e-4543c5160088 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:59.515302 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1668fc7a-a13d-4057-93e3-e16e6cec9dc7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:27:59.516703 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1668fc7a-a13d-4057-93e3-e16e6cec9dc7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:27:59.538329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1668fc7a-a13d-4057-93e3-e16e6cec9dc7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:59.538834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1668fc7a-a13d-4057-93e3-e16e6cec9dc7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:59.539294 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1668fc7a-a13d-4057-93e3-e16e6cec9dc7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:59.544654 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1668fc7a-a13d-4057-93e3-e16e6cec9dc7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:27:59.545682 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1668fc7a-a13d-4057-93e3-e16e6cec9dc7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:27:59.546376 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1668fc7a-a13d-4057-93e3-e16e6cec9dc7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:27:59.602068 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-53af3170-9a3b-49b0-971e-4543c5160088 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:59.612254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-53af3170-9a3b-49b0-971e-4543c5160088 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1503 microversion: 2.1 time: 0.221212 Sep 09 21:27:59.613426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 134/263] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:59 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:27:59.833397 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1668fc7a-a13d-4057-93e3-e16e6cec9dc7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:27:59.846544 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1668fc7a-a13d-4057-93e3-e16e6cec9dc7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.336962 Sep 09 21:27:59.847582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 130/264] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:27:59 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:00.181624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6b928a68-4b05-414d-ad27-a2259ad117fa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:00.183102 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6b928a68-4b05-414d-ad27-a2259ad117fa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:00.190941 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b928a68-4b05-414d-ad27-a2259ad117fa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:00.191809 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b928a68-4b05-414d-ad27-a2259ad117fa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:00.192322 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b928a68-4b05-414d-ad27-a2259ad117fa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:00.193528 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b928a68-4b05-414d-ad27-a2259ad117fa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:00.194080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b928a68-4b05-414d-ad27-a2259ad117fa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:00.194584 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b928a68-4b05-414d-ad27-a2259ad117fa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:00.224063 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6b928a68-4b05-414d-ad27-a2259ad117fa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/ips" status: 200 len: 152 microversion: 2.20 time: 0.046887 Sep 09 21:28:00.224758 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 135/265] 10.222.0.46 () {60 vars in 1289 bytes} [Fri Sep 9 21:28:00 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:28:00.648618 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d03153bc-5e96-4fa6-981e-d2d51eb62425 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:00.650193 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d03153bc-5e96-4fa6-981e-d2d51eb62425 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:00.661685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d03153bc-5e96-4fa6-981e-d2d51eb62425 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:00.662454 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d03153bc-5e96-4fa6-981e-d2d51eb62425 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:00.663509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d03153bc-5e96-4fa6-981e-d2d51eb62425 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:00.665130 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d03153bc-5e96-4fa6-981e-d2d51eb62425 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:00.666143 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d03153bc-5e96-4fa6-981e-d2d51eb62425 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:00.666810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d03153bc-5e96-4fa6-981e-d2d51eb62425 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:00.879052 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-57e5fc88-9c1f-4e1c-be69-8f5eb2d32bed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:00.889071 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-57e5fc88-9c1f-4e1c-be69-8f5eb2d32bed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:00.920044 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-57e5fc88-9c1f-4e1c-be69-8f5eb2d32bed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:00.920539 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-57e5fc88-9c1f-4e1c-be69-8f5eb2d32bed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:00.921202 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-57e5fc88-9c1f-4e1c-be69-8f5eb2d32bed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:00.921925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-57e5fc88-9c1f-4e1c-be69-8f5eb2d32bed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:00.923159 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-57e5fc88-9c1f-4e1c-be69-8f5eb2d32bed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:00.923609 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-57e5fc88-9c1f-4e1c-be69-8f5eb2d32bed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:01.083318 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d03153bc-5e96-4fa6-981e-d2d51eb62425 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:01.096258 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d03153bc-5e96-4fa6-981e-d2d51eb62425 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1503 microversion: 2.1 time: 0.456347 Sep 09 21:28:01.097185 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 131/266] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:00 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1503 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:01.151865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-57e5fc88-9c1f-4e1c-be69-8f5eb2d32bed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:01.158509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-c71dcfc5-1b4a-4e24-8802-6663bd166e1b req-177ed85a-4cea-497b-93a7-12eb1e0f382a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e31e51-b8fd-4b97-a4d1-a5c515b8d72d", "name": "network-vif-deleted", "tag": "62996df3-8340-425a-9c17-524f56c384d4"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:01.163714 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:01.169566 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-57e5fc88-9c1f-4e1c-be69-8f5eb2d32bed tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.298548 Sep 09 21:28:01.170363 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-c71dcfc5-1b4a-4e24-8802-6663bd166e1b req-177ed85a-4cea-497b-93a7-12eb1e0f382a service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:01.171867 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-c71dcfc5-1b4a-4e24-8802-6663bd166e1b req-177ed85a-4cea-497b-93a7-12eb1e0f382a service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:01.172418 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-c71dcfc5-1b4a-4e24-8802-6663bd166e1b req-177ed85a-4cea-497b-93a7-12eb1e0f382a service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:01.177052 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 136/267] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:00 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:01.188731 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-c71dcfc5-1b4a-4e24-8802-6663bd166e1b req-177ed85a-4cea-497b-93a7-12eb1e0f382a service nova] Creating event network-vif-deleted:62996df3-8340-425a-9c17-524f56c384d4 for instance 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d on hv-cinder-85221 Sep 09 21:28:01.196471 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-c71dcfc5-1b4a-4e24-8802-6663bd166e1b req-177ed85a-4cea-497b-93a7-12eb1e0f382a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041778 Sep 09 21:28:01.197664 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 132/268] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:28:01.493057 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0520e842-fcd5-4cdd-86c3-2f9a230c1afd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Action: 'create', calling method: .version_select at 0x7f081310d0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-10145937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNytCV5DnjwzYK7czVI3bsywdM86quMyg0HJl4NVHju+uqRqxIkG7er/qTcvfv842wGBeO80QWGY6eTtu5uBAm3xBJBALvNjnkH99x0FMNbI4RVc87Mj/Bz77QKHxR5Fcg=="}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:01.517071 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-0520e842-fcd5-4cdd-86c3-2f9a230c1afd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Getting quotas for project e46e2167ee15481fab472e5b101c9c60. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:28:01.522638 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-0520e842-fcd5-4cdd-86c3-2f9a230c1afd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Getting quotas for user 469561e39c274301b16677d12cac3a67 and project e46e2167ee15481fab472e5b101c9c60. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:28:01.548408 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0520e842-fcd5-4cdd-86c3-2f9a230c1afd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.285600 Sep 09 21:28:01.548997 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 137/269] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 21:28:01 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:28:02.122057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:02.123157 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:02.142721 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:02.143945 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:02.144629 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:02.147038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:02.148128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:02.148827 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:02.194894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-754aafe0-a6ec-4277-8374-acb8e1df59a7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:02.196356 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-754aafe0-a6ec-4277-8374-acb8e1df59a7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:02.210673 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-754aafe0-a6ec-4277-8374-acb8e1df59a7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:02.212774 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-754aafe0-a6ec-4277-8374-acb8e1df59a7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:02.213443 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-754aafe0-a6ec-4277-8374-acb8e1df59a7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:02.215775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-754aafe0-a6ec-4277-8374-acb8e1df59a7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:02.216557 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-754aafe0-a6ec-4277-8374-acb8e1df59a7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:02.217196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-754aafe0-a6ec-4277-8374-acb8e1df59a7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:02.225905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:02.226837 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:02.228124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:02.229168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lazy-loading 'fault' on Instance uuid 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:28:02.300936 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba45eee6687b45158555ef5f0c595680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdf0d6145a4848a8bc624ded77bc27ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:02.308800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5a4e7648-1851-47bf-8e74-1a1b1ba09848 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 200 len: 1303 microversion: 2.1 time: 0.191582 Sep 09 21:28:02.309773 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 133/270] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:02 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 1303 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:02.439400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-754aafe0-a6ec-4277-8374-acb8e1df59a7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:02.450711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-754aafe0-a6ec-4277-8374-acb8e1df59a7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.259913 Sep 09 21:28:02.451807 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 138/271] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:02 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:03.338043 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:03.338661 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] [instance: 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:03.345388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:03.345942 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:03.346382 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:03.347072 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:03.347581 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:03.347977 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:03.362252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] HTTP exception thrown: Instance 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d could not be found. Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Request method failure captured: Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d HTTP/1.1 Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG6-vFd1y2EC9Z24VGJr-iSyZSeyOoHd8zNh1nOY7aszTbjpBMoOcRZvMv7dKGTjENi3ZPdF-ANyGk1kWWUzYJeIXNf8n5ZaacjDwW5bM9b-upp4s-OYSExOUlj5WmSQmQsVSSKlA0UreIdWO45KC9E-FLLHC3ztdgfEUI7T-qsexUvo Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: bdf0d6145a4848a8bc624ded77bc27ac Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesActionsTest-1320004840 Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:28:03.363920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bdf0d6145a4848a8bc624ded77bc27ac", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdf0d6145a4848a8bc624ded77bc27ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdf0d6145a4848a8bc624ded77bc27ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bdf0d6145a4848a8bc624ded77bc27ac"}]}] Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesActionsTest-1320004840 Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: bdf0d6145a4848a8bc624ded77bc27ac Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesActionsTest-1320004840 Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesActionsTest-1320004840-project Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: ba45eee6687b45158555ef5f0c595680 Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesActionsTest-1320004840-project Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d could not be found. Sep 09 21:28:03.365480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '26e31e51-b8fd-4b97-a4d1-a5c515b8d72d'} Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d could not be found. Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:28:03.366375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d could not be found. Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d could not be found. Sep 09 21:28:03.367817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:28:03.368929 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] Returning 404 to user: Instance 26e31e51-b8fd-4b97-a4d1-a5c515b8d72d could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:28:03.368929 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f9a51568-d5c6-4fe3-bcfc-dc5082519250 tempest-VolumesActionsTest-1320004840 tempest-VolumesActionsTest-1320004840-project] 10.222.0.46 "GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d" status: 404 len: 111 microversion: 2.1 time: 0.032506 Sep 09 21:28:03.369434 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 134/272] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:03 2022] GET /compute/v2.1/servers/26e31e51-b8fd-4b97-a4d1-a5c515b8d72d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:28:03.481011 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9156faba-0546-4472-ad5c-4764a5832af3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:03.481666 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9156faba-0546-4472-ad5c-4764a5832af3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:03.488821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9156faba-0546-4472-ad5c-4764a5832af3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:03.490641 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9156faba-0546-4472-ad5c-4764a5832af3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:03.491098 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9156faba-0546-4472-ad5c-4764a5832af3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:03.491842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9156faba-0546-4472-ad5c-4764a5832af3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:03.492309 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9156faba-0546-4472-ad5c-4764a5832af3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:03.492738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9156faba-0546-4472-ad5c-4764a5832af3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:03.660840 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9156faba-0546-4472-ad5c-4764a5832af3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:03.671198 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9156faba-0546-4472-ad5c-4764a5832af3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.194003 Sep 09 21:28:03.682038 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 139/273] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:03 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:04.581026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a0d27458-067c-402d-8e31-e5e196cf1df8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:04.581555 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a0d27458-067c-402d-8e31-e5e196cf1df8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:04.587742 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0d27458-067c-402d-8e31-e5e196cf1df8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:04.588237 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0d27458-067c-402d-8e31-e5e196cf1df8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:04.588693 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0d27458-067c-402d-8e31-e5e196cf1df8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:04.589393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0d27458-067c-402d-8e31-e5e196cf1df8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:04.589853 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0d27458-067c-402d-8e31-e5e196cf1df8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:04.590278 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a0d27458-067c-402d-8e31-e5e196cf1df8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:04.617260 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-a0d27458-067c-402d-8e31-e5e196cf1df8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lazy-loading 'flavor' on Instance uuid cb8f74a7-256c-4810-944b-e4f66773aa13 {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:28:04.695216 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c0258c3c-3a03-4541-b913-c5c08cb4dd5d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:04.696328 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c0258c3c-3a03-4541-b913-c5c08cb4dd5d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:04.704819 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c0258c3c-3a03-4541-b913-c5c08cb4dd5d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:04.705330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c0258c3c-3a03-4541-b913-c5c08cb4dd5d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:04.705781 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c0258c3c-3a03-4541-b913-c5c08cb4dd5d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:04.706523 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c0258c3c-3a03-4541-b913-c5c08cb4dd5d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:04.707127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c0258c3c-3a03-4541-b913-c5c08cb4dd5d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:04.707659 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c0258c3c-3a03-4541-b913-c5c08cb4dd5d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:04.872797 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c0258c3c-3a03-4541-b913-c5c08cb4dd5d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:04.881907 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c0258c3c-3a03-4541-b913-c5c08cb4dd5d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.190520 Sep 09 21:28:04.883598 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 140/274] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:04 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:04.888228 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a0d27458-067c-402d-8e31-e5e196cf1df8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "POST /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/action" status: 202 len: 0 microversion: 2.20 time: 0.312150 Sep 09 21:28:04.889096 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 135/275] 10.222.0.46 () {62 vars in 1319 bytes} [Fri Sep 9 21:28:04 2022] POST /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:28:04.898584 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:04.907154 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:04.916982 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:04.917849 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:04.918351 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:04.919015 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:04.919678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:04.920114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:05.061426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:05.072311 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:05.073775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:05.074979 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-509512d0-0585-4088-9af3-f66cc0373925 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.180547 Sep 09 21:28:05.075550 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 141/276] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:04 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:05.906904 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2e910905-0c79-4dd5-aad3-eca20f217a01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:05.907706 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2e910905-0c79-4dd5-aad3-eca20f217a01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:05.915313 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2e910905-0c79-4dd5-aad3-eca20f217a01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:05.915818 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2e910905-0c79-4dd5-aad3-eca20f217a01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:05.916250 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2e910905-0c79-4dd5-aad3-eca20f217a01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:05.916935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2e910905-0c79-4dd5-aad3-eca20f217a01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:05.917390 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2e910905-0c79-4dd5-aad3-eca20f217a01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:05.917821 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2e910905-0c79-4dd5-aad3-eca20f217a01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:06.052160 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2e910905-0c79-4dd5-aad3-eca20f217a01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:06.059934 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2e910905-0c79-4dd5-aad3-eca20f217a01 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.157476 Sep 09 21:28:06.060493 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 136/277] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:05 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:06.101794 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:06.102927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:06.110098 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:06.111150 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:06.111679 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:06.112404 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:06.112890 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:06.113320 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:06.249759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:06.257966 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:06.259407 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:06.260606 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4b8a8981-6976-49bd-bb50-a49affba194a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.162781 Sep 09 21:28:06.261171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 142/278] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:06 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:07.086548 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b16cf25a-3bf9-4800-a253-fed667c1902f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:07.087110 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b16cf25a-3bf9-4800-a253-fed667c1902f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:07.093572 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b16cf25a-3bf9-4800-a253-fed667c1902f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:07.094667 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b16cf25a-3bf9-4800-a253-fed667c1902f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:07.095107 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b16cf25a-3bf9-4800-a253-fed667c1902f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:07.095829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b16cf25a-3bf9-4800-a253-fed667c1902f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:07.096281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b16cf25a-3bf9-4800-a253-fed667c1902f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:07.096705 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b16cf25a-3bf9-4800-a253-fed667c1902f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:07.230864 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b16cf25a-3bf9-4800-a253-fed667c1902f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:07.239218 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b16cf25a-3bf9-4800-a253-fed667c1902f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.156693 Sep 09 21:28:07.239825 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 137/279] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:07 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:07.286945 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:07.287752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:07.294530 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:07.295021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:07.295456 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:07.296175 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:07.296629 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:07.297108 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:07.435162 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:07.443205 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:07.444682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:07.445839 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-22f74e26-13e9-4568-aeae-a2873cdbe862 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.163351 Sep 09 21:28:07.446384 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 143/280] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:07 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:08.262226 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3eb6e72a-56c6-4731-b2e6-1f1915e07dc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:08.263120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3eb6e72a-56c6-4731-b2e6-1f1915e07dc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:08.270319 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eb6e72a-56c6-4731-b2e6-1f1915e07dc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:08.270878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eb6e72a-56c6-4731-b2e6-1f1915e07dc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:08.271319 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eb6e72a-56c6-4731-b2e6-1f1915e07dc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:08.272046 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eb6e72a-56c6-4731-b2e6-1f1915e07dc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:08.272498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eb6e72a-56c6-4731-b2e6-1f1915e07dc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:08.273096 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eb6e72a-56c6-4731-b2e6-1f1915e07dc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:08.412110 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-3eb6e72a-56c6-4731-b2e6-1f1915e07dc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:08.419873 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3eb6e72a-56c6-4731-b2e6-1f1915e07dc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.161560 Sep 09 21:28:08.420442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 138/281] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:08 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:08.473136 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:08.473723 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:08.480519 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:08.481002 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:08.481433 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:08.482124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:08.482575 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:08.482997 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:08.627900 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:08.636577 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:08.638640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:08.639646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e5e7c369-8632-485f-a987-e5d0119baf2f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.171043 Sep 09 21:28:08.640196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 144/282] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:08 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:09.442865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3c5713b4-d5f0-460e-9c42-96d880c200e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:09.443475 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3c5713b4-d5f0-460e-9c42-96d880c200e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:09.449294 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3c5713b4-d5f0-460e-9c42-96d880c200e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:09.449780 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3c5713b4-d5f0-460e-9c42-96d880c200e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:09.450213 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3c5713b4-d5f0-460e-9c42-96d880c200e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:09.450894 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3c5713b4-d5f0-460e-9c42-96d880c200e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:09.451351 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3c5713b4-d5f0-460e-9c42-96d880c200e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:09.451805 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3c5713b4-d5f0-460e-9c42-96d880c200e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:09.577924 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-3c5713b4-d5f0-460e-9c42-96d880c200e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:09.586694 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3c5713b4-d5f0-460e-9c42-96d880c200e8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.148498 Sep 09 21:28:09.587263 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 139/283] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:09 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:09.665638 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:09.666245 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:09.672553 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:09.673560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:09.673986 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:09.674658 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:09.675113 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:09.675548 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:09.807194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:09.815954 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:09.817377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:09.818519 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f51a7731-0b5e-4d73-9129-ba1ea0198d7d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.156703 Sep 09 21:28:09.819075 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 145/284] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:09 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:10.609862 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-fc11503c-566d-4d82-be9b-cd8293593342 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:10.610995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-fc11503c-566d-4d82-be9b-cd8293593342 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:10.617284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fc11503c-566d-4d82-be9b-cd8293593342 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:10.617750 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fc11503c-566d-4d82-be9b-cd8293593342 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:10.618183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fc11503c-566d-4d82-be9b-cd8293593342 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:10.618858 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fc11503c-566d-4d82-be9b-cd8293593342 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:10.619308 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fc11503c-566d-4d82-be9b-cd8293593342 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:10.619768 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fc11503c-566d-4d82-be9b-cd8293593342 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:10.762021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-fc11503c-566d-4d82-be9b-cd8293593342 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:10.770459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-fc11503c-566d-4d82-be9b-cd8293593342 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.164584 Sep 09 21:28:10.771129 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 140/285] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:10 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:10.843812 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:10.844455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:10.850905 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:10.851399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:10.851880 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:10.852565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:10.853053 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:10.853482 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:10.989023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:10.997454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:10.998897 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:11.000094 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f8442bb0-9cb2-462b-8ca6-ea53be0fdc58 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.160247 Sep 09 21:28:11.000655 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 146/286] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:10 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:11.793709 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c59bfa22-eff3-49d8-998b-fa5d05635e73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:11.794347 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c59bfa22-eff3-49d8-998b-fa5d05635e73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:11.800264 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c59bfa22-eff3-49d8-998b-fa5d05635e73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:11.800736 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c59bfa22-eff3-49d8-998b-fa5d05635e73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:11.801162 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c59bfa22-eff3-49d8-998b-fa5d05635e73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:11.801871 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c59bfa22-eff3-49d8-998b-fa5d05635e73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:11.802317 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c59bfa22-eff3-49d8-998b-fa5d05635e73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:11.802733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c59bfa22-eff3-49d8-998b-fa5d05635e73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:11.933385 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c59bfa22-eff3-49d8-998b-fa5d05635e73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:11.941660 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c59bfa22-eff3-49d8-998b-fa5d05635e73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.151789 Sep 09 21:28:11.942220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 141/287] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:11 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:12.027964 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:12.028568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:12.030488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=4 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:12.037418 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:12.037877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:12.038305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:12.038984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:12.039430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:12.039872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:12.184694 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:12.192822 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:12.194284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:12.195433 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-fadf3cb2-d91c-41b2-ad6b-365200f08156 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.171311 Sep 09 21:28:12.196017 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 147/288] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:12 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:12.964504 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-80177f53-e0e8-4aa1-aa9b-b2079f238dbc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:12.965109 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-80177f53-e0e8-4aa1-aa9b-b2079f238dbc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:12.970954 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80177f53-e0e8-4aa1-aa9b-b2079f238dbc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:12.972045 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80177f53-e0e8-4aa1-aa9b-b2079f238dbc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:12.972476 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80177f53-e0e8-4aa1-aa9b-b2079f238dbc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:12.973150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80177f53-e0e8-4aa1-aa9b-b2079f238dbc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:12.973606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80177f53-e0e8-4aa1-aa9b-b2079f238dbc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:12.974027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-80177f53-e0e8-4aa1-aa9b-b2079f238dbc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:13.106412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-80177f53-e0e8-4aa1-aa9b-b2079f238dbc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:13.114398 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-80177f53-e0e8-4aa1-aa9b-b2079f238dbc tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.153703 Sep 09 21:28:13.114968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 142/289] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:12 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:13.223165 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:13.224223 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:13.231172 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:13.231761 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:13.232288 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:13.233049 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:13.233608 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:13.234098 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:13.365484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:13.373459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:13.374901 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:13.376284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4afd80fa-3d36-4226-846d-533453e64afa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.158190 Sep 09 21:28:13.376841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 148/290] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:13 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:14.137074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a03e2bdd-04b9-4051-9012-f84874d9dfce tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:14.137685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a03e2bdd-04b9-4051-9012-f84874d9dfce tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:14.144222 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a03e2bdd-04b9-4051-9012-f84874d9dfce tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:14.144697 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a03e2bdd-04b9-4051-9012-f84874d9dfce tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:14.145130 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a03e2bdd-04b9-4051-9012-f84874d9dfce tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:14.145798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a03e2bdd-04b9-4051-9012-f84874d9dfce tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:14.146249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a03e2bdd-04b9-4051-9012-f84874d9dfce tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:14.146662 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a03e2bdd-04b9-4051-9012-f84874d9dfce tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:14.276654 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a03e2bdd-04b9-4051-9012-f84874d9dfce tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:14.285138 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a03e2bdd-04b9-4051-9012-f84874d9dfce tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.151987 Sep 09 21:28:14.285702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 143/291] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:14 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:14.403602 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:14.404523 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:14.416210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:14.416711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:14.417146 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:14.417847 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:14.418465 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:14.419287 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:14.571702 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:14.579902 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:14.581811 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:14.582685 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e88802f5-ce54-4bfb-a061-35e0187b1772 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.184172 Sep 09 21:28:14.583391 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 149/292] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:14 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:15.308858 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c7bf78dd-5672-4bbb-a0c0-0a1247a8627c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:15.309475 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c7bf78dd-5672-4bbb-a0c0-0a1247a8627c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:15.316159 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c7bf78dd-5672-4bbb-a0c0-0a1247a8627c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:15.316648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c7bf78dd-5672-4bbb-a0c0-0a1247a8627c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:15.317093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c7bf78dd-5672-4bbb-a0c0-0a1247a8627c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:15.318031 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c7bf78dd-5672-4bbb-a0c0-0a1247a8627c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:15.319019 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c7bf78dd-5672-4bbb-a0c0-0a1247a8627c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:15.319455 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c7bf78dd-5672-4bbb-a0c0-0a1247a8627c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:15.484475 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c7bf78dd-5672-4bbb-a0c0-0a1247a8627c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:15.492404 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c7bf78dd-5672-4bbb-a0c0-0a1247a8627c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.187332 Sep 09 21:28:15.503789 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 144/293] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:15 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:15.610786 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:15.612777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:15.620107 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:15.620597 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:15.621025 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:15.621714 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:15.639481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:15.639960 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:15.842095 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:15.851679 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:15.853760 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:15.856042 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3890b964-e16f-49e2-9596-a133bfca8994 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.249002 Sep 09 21:28:15.864730 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 150/294] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:15 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:16.012442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-003d7cf8-c911-4cd4-9840-c149afd8eb26 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:16.013200 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-003d7cf8-c911-4cd4-9840-c149afd8eb26 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:16.020494 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-003d7cf8-c911-4cd4-9840-c149afd8eb26 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:16.021525 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-003d7cf8-c911-4cd4-9840-c149afd8eb26 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:16.022121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-003d7cf8-c911-4cd4-9840-c149afd8eb26 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:16.022992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-003d7cf8-c911-4cd4-9840-c149afd8eb26 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:16.023506 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-003d7cf8-c911-4cd4-9840-c149afd8eb26 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:16.023953 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-003d7cf8-c911-4cd4-9840-c149afd8eb26 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:16.028861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:16.056222 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-003d7cf8-c911-4cd4-9840-c149afd8eb26 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/ips" status: 200 len: 145 microversion: 2.1 time: 0.047959 Sep 09 21:28:16.057058 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 145/295] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:28:16 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/ips => generated 145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:28:16.514822 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b0df4399-b9ae-4d29-a5a4-f30c5c9e9aa1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:16.515560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b0df4399-b9ae-4d29-a5a4-f30c5c9e9aa1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:16.524865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0df4399-b9ae-4d29-a5a4-f30c5c9e9aa1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:16.525518 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0df4399-b9ae-4d29-a5a4-f30c5c9e9aa1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:16.536192 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0df4399-b9ae-4d29-a5a4-f30c5c9e9aa1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:16.536996 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0df4399-b9ae-4d29-a5a4-f30c5c9e9aa1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:16.537565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0df4399-b9ae-4d29-a5a4-f30c5c9e9aa1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:16.538767 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0df4399-b9ae-4d29-a5a4-f30c5c9e9aa1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:16.699143 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b0df4399-b9ae-4d29-a5a4-f30c5c9e9aa1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:16.707565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b0df4399-b9ae-4d29-a5a4-f30c5c9e9aa1 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.196522 Sep 09 21:28:16.708427 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 151/296] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:16 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:16.886592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:16.887236 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:16.895124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:16.895709 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:16.896372 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:16.897277 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:16.898212 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:16.898876 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:17.045130 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:17.054614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:17.056231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:17.057424 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-55f8e290-5723-4abc-8916-2cf3da6016c9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.175867 Sep 09 21:28:17.067567 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 146/297] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:16 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:17.730749 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bdf030e1-7e1f-484e-b641-69497742f081 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:17.735629 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bdf030e1-7e1f-484e-b641-69497742f081 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:17.738768 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdf030e1-7e1f-484e-b641-69497742f081 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:17.739734 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdf030e1-7e1f-484e-b641-69497742f081 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:17.740414 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdf030e1-7e1f-484e-b641-69497742f081 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:17.741126 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdf030e1-7e1f-484e-b641-69497742f081 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:17.741752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdf030e1-7e1f-484e-b641-69497742f081 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:17.742345 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdf030e1-7e1f-484e-b641-69497742f081 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:17.925696 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bdf030e1-7e1f-484e-b641-69497742f081 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:17.937741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bdf030e1-7e1f-484e-b641-69497742f081 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.211204 Sep 09 21:28:17.954195 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 152/298] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:17 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:18.088261 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:18.088959 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:18.095392 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:18.096218 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:18.096850 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:18.097564 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:18.098057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:18.098468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:18.249017 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:18.258495 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:18.259961 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:18.261255 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-dd7537e7-4a7f-4c3b-9467-d47a70accd11 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.178425 Sep 09 21:28:18.261836 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 147/299] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:18 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:18.977933 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-adb42c34-3af5-4139-a3d3-f63504e91d81 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:18.980014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-adb42c34-3af5-4139-a3d3-f63504e91d81 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:18.990153 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-adb42c34-3af5-4139-a3d3-f63504e91d81 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:18.991209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-adb42c34-3af5-4139-a3d3-f63504e91d81 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:18.992217 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-adb42c34-3af5-4139-a3d3-f63504e91d81 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:18.993402 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-adb42c34-3af5-4139-a3d3-f63504e91d81 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:18.994155 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-adb42c34-3af5-4139-a3d3-f63504e91d81 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:18.995064 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-adb42c34-3af5-4139-a3d3-f63504e91d81 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.220740 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-844e241d-d4ec-41ee-b39f-67f0e418c7aa tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbafbcb1-8cbb-47e8-b62c-dd18caaa094a"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:19.224850 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-844e241d-d4ec-41ee-b39f-67f0e418c7aa tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:19.265366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-844e241d-d4ec-41ee-b39f-67f0e418c7aa tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:19.266136 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-844e241d-d4ec-41ee-b39f-67f0e418c7aa tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:19.266863 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-844e241d-d4ec-41ee-b39f-67f0e418c7aa tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.268638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-844e241d-d4ec-41ee-b39f-67f0e418c7aa tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:19.269202 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-844e241d-d4ec-41ee-b39f-67f0e418c7aa tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:19.269766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-844e241d-d4ec-41ee-b39f-67f0e418c7aa tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.272236 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-adb42c34-3af5-4139-a3d3-f63504e91d81 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:19.284769 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-adb42c34-3af5-4139-a3d3-f63504e91d81 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1502 microversion: 2.1 time: 0.323206 Sep 09 21:28:19.287516 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 153/300] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:18 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1502 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:19.292647 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:19.293407 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:19.315410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:19.316297 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:19.316772 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.317615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:19.317996 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:19.321179 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.370515 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=100 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:19.514513 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:19.533028 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:19.535706 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:19.544326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-03b0f2ad-8c7f-4962-9e7e-41e4809b8399 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.255553 Sep 09 21:28:19.544907 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 154/301] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:19 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:19.554709 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8780ce52-b8d8-4cb4-8b8f-4af4816711c2"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:19.559805 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:19.573426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:19.574033 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:19.574472 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.575184 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:19.575675 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:19.576179 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.604397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] HTTP exception thrown: Cannot 'attach_volume' instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe while it is in vm_state rescued Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Request method failure captured: Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: POST /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe/os-volume_attachments HTTP/1.1 Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 74 Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG6-hYeoA0KilbcouWpERZ9YtQ82F_IJMypUZNsqF-LHQO0jXBghrw_akyfPTZ9RfD5QZsUC56WPkMWHPye2TMrxCBvzQNtqia3kTLk6srJ6joD45wfLdTCle-w3LQa2RNfPLhaz2Ly1gmO4Nr9NiDeNh0DEz2qj6shMAQnL2Zfug0yo Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 5472cdfe59524ac5b826fba54758c68f Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:28:19.606171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5472cdfe59524ac5b826fba54758c68f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5472cdfe59524ac5b826fba54758c68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5472cdfe59524ac5b826fba54758c68f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5472cdfe59524ac5b826fba54758c68f"}]}] Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 5472cdfe59524ac5b826fba54758c68f Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-ServerRescueNegativeTestJSON-1311387682-project Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 0d773c7f6aca4ea2ad2872f67e9116af Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311387682-project Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {"volumeAttachment": {"volumeId": "8780ce52-b8d8-4cb4-8b8f-4af4816711c2"}} Sep 09 21:28:19.607741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Cannot 'attach_volume' instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe while it is in vm_state rescued Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'server_id': '5eedc741-6d4f-4cbd-9a25-a712414a9bbe', 'body': {'volumeAttachment': {'volumeId': '8780ce52-b8d8-4cb4-8b8f-4af4816711c2'}}} Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:28:19.608712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe while it is in vm_state rescued Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:28:19.610124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:28:19.612724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:28:19.612724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:28:19.612724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe while it is in vm_state rescued Sep 09 21:28:19.612724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:28:19.612724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Returning 409 to user: Cannot 'attach_volume' instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe while it is in vm_state rescued {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:28:19.612724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-43e51155-71f6-4cbc-bb6f-c127dd65a1dd tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056845 Sep 09 21:28:19.612724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 155/302] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:28:19 2022] POST /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 21:28:19.617320 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-56b7c300-73bf-488d-b52c-fbfc52da5d34 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:19.617886 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-56b7c300-73bf-488d-b52c-fbfc52da5d34 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:19.624214 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56b7c300-73bf-488d-b52c-fbfc52da5d34 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:19.624721 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56b7c300-73bf-488d-b52c-fbfc52da5d34 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:19.625167 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56b7c300-73bf-488d-b52c-fbfc52da5d34 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.625874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56b7c300-73bf-488d-b52c-fbfc52da5d34 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:19.626331 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56b7c300-73bf-488d-b52c-fbfc52da5d34 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:19.626759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56b7c300-73bf-488d-b52c-fbfc52da5d34 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.713138 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-56b7c300-73bf-488d-b52c-fbfc52da5d34 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe/action" status: 202 len: 0 microversion: 2.1 time: 0.099200 Sep 09 21:28:19.717459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 156/303] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:28:19 2022] POST /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:28:19.724805 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b9e89cc4-91fd-4136-b09d-a5ac2c4bb1c2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:19.725775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b9e89cc4-91fd-4136-b09d-a5ac2c4bb1c2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:19.734339 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9e89cc4-91fd-4136-b09d-a5ac2c4bb1c2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:19.735187 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9e89cc4-91fd-4136-b09d-a5ac2c4bb1c2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:19.735960 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9e89cc4-91fd-4136-b09d-a5ac2c4bb1c2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.737636 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9e89cc4-91fd-4136-b09d-a5ac2c4bb1c2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:19.739109 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9e89cc4-91fd-4136-b09d-a5ac2c4bb1c2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:19.739757 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9e89cc4-91fd-4136-b09d-a5ac2c4bb1c2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:19.748494 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-844e241d-d4ec-41ee-b39f-67f0e418c7aa tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533505 Sep 09 21:28:19.749443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 148/304] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:28:19 2022] POST /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:28:19.975052 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b9e89cc4-91fd-4136-b09d-a5ac2c4bb1c2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:19.983287 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b9e89cc4-91fd-4136-b09d-a5ac2c4bb1c2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1510 microversion: 2.1 time: 0.264266 Sep 09 21:28:19.987138 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 157/305] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:19 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:20.573488 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:20.574535 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:20.581913 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:20.582404 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:20.582847 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:20.583561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:20.584217 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:20.584657 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:20.727176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:20.737024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:20.738940 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:20.740160 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-88a6a88d-c3da-4218-862d-7e8de66bf765 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.172081 Sep 09 21:28:20.741105 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 149/306] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:20 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:21.010598 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-80090dc1-ace6-482d-8eca-4744a380de7b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:21.011939 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-80090dc1-ace6-482d-8eca-4744a380de7b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:21.018794 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80090dc1-ace6-482d-8eca-4744a380de7b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:21.019740 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80090dc1-ace6-482d-8eca-4744a380de7b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:21.020380 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80090dc1-ace6-482d-8eca-4744a380de7b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:21.021285 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80090dc1-ace6-482d-8eca-4744a380de7b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:21.021944 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80090dc1-ace6-482d-8eca-4744a380de7b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:21.022571 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80090dc1-ace6-482d-8eca-4744a380de7b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:21.173483 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-80090dc1-ace6-482d-8eca-4744a380de7b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:21.182651 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-80090dc1-ace6-482d-8eca-4744a380de7b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1510 microversion: 2.1 time: 0.176321 Sep 09 21:28:21.183221 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 158/307] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:21 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:21.765965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:21.766671 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:21.775263 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:21.775847 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:21.776407 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:21.777117 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:21.777575 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:21.778068 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:21.928076 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:21.941502 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:21.943229 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:21.944687 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3489c77d-e9b8-4ddd-8a3d-cbf3b37dafa1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.183759 Sep 09 21:28:21.946086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 150/308] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:21 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:22.207307 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-95aeb0d8-0ca6-4989-a821-a4c19fd99616 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:22.208044 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-95aeb0d8-0ca6-4989-a821-a4c19fd99616 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:22.214794 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95aeb0d8-0ca6-4989-a821-a4c19fd99616 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:22.215272 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95aeb0d8-0ca6-4989-a821-a4c19fd99616 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:22.215724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95aeb0d8-0ca6-4989-a821-a4c19fd99616 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:22.216747 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95aeb0d8-0ca6-4989-a821-a4c19fd99616 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:22.217211 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95aeb0d8-0ca6-4989-a821-a4c19fd99616 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:22.217664 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95aeb0d8-0ca6-4989-a821-a4c19fd99616 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:22.370128 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-95aeb0d8-0ca6-4989-a821-a4c19fd99616 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:22.378798 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-95aeb0d8-0ca6-4989-a821-a4c19fd99616 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1510 microversion: 2.1 time: 0.176381 Sep 09 21:28:22.379654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 159/309] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:22 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:22.971686 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:22.972300 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:22.978621 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:22.979097 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:22.979547 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:22.980361 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:22.980815 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:22.981238 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:23.158132 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:23.167868 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:23.169646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:23.170996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0a65e397-8de1-4632-ac30-62e355435d6c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.203356 Sep 09 21:28:23.188252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 151/310] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:22 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:23.403201 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2d320fc0-2a8e-4e74-b678-b738a99a207e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:23.404531 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2d320fc0-2a8e-4e74-b678-b738a99a207e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:23.422189 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2d320fc0-2a8e-4e74-b678-b738a99a207e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:23.425429 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2d320fc0-2a8e-4e74-b678-b738a99a207e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:23.426343 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2d320fc0-2a8e-4e74-b678-b738a99a207e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:23.428982 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2d320fc0-2a8e-4e74-b678-b738a99a207e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:23.431015 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2d320fc0-2a8e-4e74-b678-b738a99a207e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:23.431833 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2d320fc0-2a8e-4e74-b678-b738a99a207e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:23.575636 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2d320fc0-2a8e-4e74-b678-b738a99a207e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:23.586563 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2d320fc0-2a8e-4e74-b678-b738a99a207e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1510 microversion: 2.1 time: 0.187310 Sep 09 21:28:23.587459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 160/311] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:23 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:24.198560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:24.199498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:24.207567 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:24.208077 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:24.208517 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:24.209228 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:24.209715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:24.210140 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:24.359852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:24.369487 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:24.370916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:24.372356 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-738f0001-6afd-47be-afe5-aedf5e6e6c87 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.177892 Sep 09 21:28:24.372968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 152/312] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:24 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:24.609974 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f6aaf5c8-7d2c-4c74-a7d6-ec48360a4fcf tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:24.611790 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f6aaf5c8-7d2c-4c74-a7d6-ec48360a4fcf tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:24.618478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6aaf5c8-7d2c-4c74-a7d6-ec48360a4fcf tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:24.619193 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6aaf5c8-7d2c-4c74-a7d6-ec48360a4fcf tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:24.619656 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6aaf5c8-7d2c-4c74-a7d6-ec48360a4fcf tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:24.620356 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6aaf5c8-7d2c-4c74-a7d6-ec48360a4fcf tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:24.620817 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6aaf5c8-7d2c-4c74-a7d6-ec48360a4fcf tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:24.621246 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6aaf5c8-7d2c-4c74-a7d6-ec48360a4fcf tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:24.783240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f6aaf5c8-7d2c-4c74-a7d6-ec48360a4fcf tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:24.794283 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f6aaf5c8-7d2c-4c74-a7d6-ec48360a4fcf tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1516 microversion: 2.1 time: 0.188053 Sep 09 21:28:24.796570 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 161/313] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:24 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:25.398957 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:25.400132 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:25.406620 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:25.407126 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:25.407762 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:25.409505 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:25.409957 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:25.410378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:25.541572 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:25.550688 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:25.552186 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:25.553347 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-54362ec5-9f52-442b-8feb-7a63b0755c3f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.158403 Sep 09 21:28:25.553893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 153/314] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:25 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:26.582021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:26.582757 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:26.592320 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:26.593123 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:26.593940 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:26.595265 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:26.596259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:26.597287 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:26.760951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:26.772439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:26.774789 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:26.776417 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-38a3d9a4-ac62-485a-85d0-bf88befb2d26 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.200510 Sep 09 21:28:26.777166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 162/315] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:26 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:27.296799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-08e7ea75-cfb0-45ee-8ea8-365fda3f6dc3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'create', calling method: .version_select at 0x7f0813042700>, body: {"keypair": {"name": "tempest-keypair-1286882700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/bDDENAKsH6klNO0RU2UuA4GLlvXfnrjivuzBT6aK/ILKD0IVbSYxtdwM66N23P8WiNSoSUSK7tKJYw4ycMXOSAr0gMUQmu38+C6OBvBXcK8PQKkI3sQxu5X7+dJeCIA=="}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:27.326309 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-08e7ea75-cfb0-45ee-8ea8-365fda3f6dc3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Getting quotas for project 5472cdfe59524ac5b826fba54758c68f. Resources: {'key_pairs'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:28:27.331401 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-08e7ea75-cfb0-45ee-8ea8-365fda3f6dc3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Getting quotas for user 0d773c7f6aca4ea2ad2872f67e9116af and project 5472cdfe59524ac5b826fba54758c68f. Resources: {'key_pairs'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:28:27.387814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-08e7ea75-cfb0-45ee-8ea8-365fda3f6dc3 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094701 Sep 09 21:28:27.388412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 154/316] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 21:28:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:28:27.806802 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:27.808394 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:27.833188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:27.835245 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:27.836271 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:27.837325 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:27.838061 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:27.838775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:27.993910 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:28.013745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:28.015196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:28.021168 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ba748bdf-644f-4270-b748-2df14f094e48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.219345 Sep 09 21:28:28.022311 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 163/317] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:27 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:29.051037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:29.052702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:29.054978 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:29.060228 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:29.060995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:29.061432 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:29.062308 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:29.062771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:29.063190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:29.146391 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-919474145", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91289760-21fd-42ad-9632-180f81ec1122"}], "security_groups": [{"name": "tempest-securitygroup--1076473671"}], "key_name": "tempest-keypair-1286882700", "user_data": "}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:29.287196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.network.neutron [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] validate_networks() for [('91289760-21fd-42ad-9632-180f81ec1122', None, None, None, None, None)] {{(pid=120465) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:28:29.399016 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:29.411427 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:29.413289 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:29.414866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-98caa081-25c7-43cc-8d6a-eb8bffdcbd02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.368540 Sep 09 21:28:29.416445 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 155/318] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:29 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:29.565539 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:29.789322 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Flavor limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:28:29.790239 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Image limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:28:29.791434 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Flavor pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:28:29.792392 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Image pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:28:29.793367 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:28:29.804013 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:29.804505 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:29.805027 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:29.805963 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:29.806672 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:29.807400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:29.830790 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Getting quotas for project 5472cdfe59524ac5b826fba54758c68f. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:28:29.836916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Getting quotas for user 0d773c7f6aca4ea2ad2872f67e9116af and project 5472cdfe59524ac5b826fba54758c68f. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:28:29.850988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Going to run 1 instances... {{(pid=120465) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:28:29.853944 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:28:29.908467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-671760fa-6bc0-4dfa-80e5-21ebd9fac18f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.765980 Sep 09 21:28:29.910232 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 164/319] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:28:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 21:28:29.921378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-fd6957ca-f948-46dc-ba43-9f2a9d4d64da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:29.921989 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-fd6957ca-f948-46dc-ba43-9f2a9d4d64da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:30.009859 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-fd6957ca-f948-46dc-ba43-9f2a9d4d64da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:30.021842 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-fd6957ca-f948-46dc-ba43-9f2a9d4d64da tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1245 microversion: 2.1 time: 0.104227 Sep 09 21:28:30.022412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 156/320] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:29 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:30.446515 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:30.447135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:30.454214 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:30.455035 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:30.455477 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:30.456209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:30.457048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:30.457636 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:30.619795 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:30.646330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:30.647941 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:30.649769 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-99d88e6e-fd7a-4fb9-b086-2f6578b9839d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.207555 Sep 09 21:28:30.650661 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 165/321] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:30 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:28:31.049368 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-bb0ca503-b402-407a-b28f-6d0db5459915 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:31.052324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-bb0ca503-b402-407a-b28f-6d0db5459915 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:31.060732 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb0ca503-b402-407a-b28f-6d0db5459915 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:31.062220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb0ca503-b402-407a-b28f-6d0db5459915 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:31.062890 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb0ca503-b402-407a-b28f-6d0db5459915 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:31.064765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb0ca503-b402-407a-b28f-6d0db5459915 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:31.065451 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb0ca503-b402-407a-b28f-6d0db5459915 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:31.066101 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb0ca503-b402-407a-b28f-6d0db5459915 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:31.172967 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-bb0ca503-b402-407a-b28f-6d0db5459915 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:31.180876 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-bb0ca503-b402-407a-b28f-6d0db5459915 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1249 microversion: 2.1 time: 0.136373 Sep 09 21:28:31.181440 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 157/322] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:31 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1249 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:31.676621 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:31.677211 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:31.683341 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:31.694496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:31.695173 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:31.696158 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:31.696923 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:31.697525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:31.805205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0e6c7e3e-fff5-4d42-b4c3-3650825bb4fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:31.812028 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0e6c7e3e-fff5-4d42-b4c3-3650825bb4fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:31.812768 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0e6c7e3e-fff5-4d42-b4c3-3650825bb4fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:31.813377 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0e6c7e3e-fff5-4d42-b4c3-3650825bb4fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:31.896936 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0e6c7e3e-fff5-4d42-b4c3-3650825bb4fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Going to try to stop instance {{(pid=120466) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 21:28:31.901995 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:31.913398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:31.915378 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:31.916785 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d8468cb4-f434-49b3-a9f0-16439ae64504 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1746 microversion: 2.20 time: 0.244548 Sep 09 21:28:31.917339 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 166/323] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:31 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1746 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:31.965319 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0e6c7e3e-fff5-4d42-b4c3-3650825bb4fe tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/action" status: 202 len: 0 microversion: 2.1 time: 0.167400 Sep 09 21:28:31.967566 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 158/324] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:28:31 2022] POST /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:28:31.975009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-72ede382-5cec-4d38-a62f-04432ebc6ca7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:31.978587 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-72ede382-5cec-4d38-a62f-04432ebc6ca7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:31.985301 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72ede382-5cec-4d38-a62f-04432ebc6ca7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:31.986380 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72ede382-5cec-4d38-a62f-04432ebc6ca7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:31.986994 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72ede382-5cec-4d38-a62f-04432ebc6ca7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:31.987935 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72ede382-5cec-4d38-a62f-04432ebc6ca7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:31.988801 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72ede382-5cec-4d38-a62f-04432ebc6ca7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:31.989566 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72ede382-5cec-4d38-a62f-04432ebc6ca7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:32.202397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-72ede382-5cec-4d38-a62f-04432ebc6ca7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:32.208134 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-848ae4b9-73e6-4ed9-a936-e2e746b67372 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:32.208852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-848ae4b9-73e6-4ed9-a936-e2e746b67372 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:32.219967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-72ede382-5cec-4d38-a62f-04432ebc6ca7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.249014 Sep 09 21:28:32.233025 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 167/325] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:31 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:32.237326 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-848ae4b9-73e6-4ed9-a936-e2e746b67372 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:32.238221 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-848ae4b9-73e6-4ed9-a936-e2e746b67372 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:32.238852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-848ae4b9-73e6-4ed9-a936-e2e746b67372 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:32.239947 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-848ae4b9-73e6-4ed9-a936-e2e746b67372 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:32.241488 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-848ae4b9-73e6-4ed9-a936-e2e746b67372 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:32.242842 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-848ae4b9-73e6-4ed9-a936-e2e746b67372 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:32.321720 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-848ae4b9-73e6-4ed9-a936-e2e746b67372 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:32.331868 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-848ae4b9-73e6-4ed9-a936-e2e746b67372 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1297 microversion: 2.1 time: 0.128565 Sep 09 21:28:32.332591 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 159/326] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:32 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1297 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:32.944640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:32.946109 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:32.952671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:32.953369 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:32.953807 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:32.954880 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:32.955748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:32.956390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:33.144521 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:33.154694 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:33.156515 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:33.158028 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8269a6e3-7a36-41ad-bd70-c674323c3228 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1746 microversion: 2.20 time: 0.217513 Sep 09 21:28:33.160002 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 168/327] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:32 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:33.246068 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-51273d49-6250-43d6-a630-4f772c839b59 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:33.246669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-51273d49-6250-43d6-a630-4f772c839b59 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:33.259440 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-51273d49-6250-43d6-a630-4f772c839b59 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:33.260332 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-51273d49-6250-43d6-a630-4f772c839b59 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:33.261421 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-51273d49-6250-43d6-a630-4f772c839b59 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:33.264376 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-51273d49-6250-43d6-a630-4f772c839b59 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:33.265055 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-51273d49-6250-43d6-a630-4f772c839b59 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:33.266015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-51273d49-6250-43d6-a630-4f772c839b59 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:33.356853 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b15d6158-e4c3-49a1-b548-b38213e6d1e9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:33.357848 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b15d6158-e4c3-49a1-b548-b38213e6d1e9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:33.365404 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b15d6158-e4c3-49a1-b548-b38213e6d1e9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:33.366244 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b15d6158-e4c3-49a1-b548-b38213e6d1e9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:33.366903 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b15d6158-e4c3-49a1-b548-b38213e6d1e9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:33.367885 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b15d6158-e4c3-49a1-b548-b38213e6d1e9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:33.368550 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b15d6158-e4c3-49a1-b548-b38213e6d1e9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:33.369889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b15d6158-e4c3-49a1-b548-b38213e6d1e9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:33.442957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b15d6158-e4c3-49a1-b548-b38213e6d1e9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:33.451060 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b15d6158-e4c3-49a1-b548-b38213e6d1e9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1303 microversion: 2.1 time: 0.098045 Sep 09 21:28:33.451949 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 169/328] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:33 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:33.476872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-51273d49-6250-43d6-a630-4f772c839b59 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:33.488165 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-51273d49-6250-43d6-a630-4f772c839b59 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.245249 Sep 09 21:28:33.489862 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 160/329] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:33 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:34.189050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:34.190478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:34.208807 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:34.212478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:34.213632 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:34.215868 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:34.216367 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:34.216816 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:34.479410 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d3980d26-0f1f-44f9-a031-e3f566860c74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:34.481548 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d3980d26-0f1f-44f9-a031-e3f566860c74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:34.509252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3980d26-0f1f-44f9-a031-e3f566860c74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:34.511889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3980d26-0f1f-44f9-a031-e3f566860c74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:34.514839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3980d26-0f1f-44f9-a031-e3f566860c74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:34.514839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3980d26-0f1f-44f9-a031-e3f566860c74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:34.514839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3980d26-0f1f-44f9-a031-e3f566860c74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:34.514839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3980d26-0f1f-44f9-a031-e3f566860c74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:34.588185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:34.603483 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:34.605321 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:34.607028 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ab2c89ac-fe9f-4e56-a38e-c6cfc84d9032 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1746 microversion: 2.20 time: 0.422338 Sep 09 21:28:34.607681 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 170/330] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:34 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1746 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:34.616556 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7cf029c3-02f4-4a4d-9b66-e491971a9bbb tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:34.617996 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7cf029c3-02f4-4a4d-9b66-e491971a9bbb tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:34.625279 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7cf029c3-02f4-4a4d-9b66-e491971a9bbb tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:34.626180 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7cf029c3-02f4-4a4d-9b66-e491971a9bbb tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:34.627825 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7cf029c3-02f4-4a4d-9b66-e491971a9bbb tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:34.628791 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7cf029c3-02f4-4a4d-9b66-e491971a9bbb tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:34.629478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7cf029c3-02f4-4a4d-9b66-e491971a9bbb tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:34.630122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7cf029c3-02f4-4a4d-9b66-e491971a9bbb tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:34.645132 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:34.869083 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7cf029c3-02f4-4a4d-9b66-e491971a9bbb tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:34.880925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7cf029c3-02f4-4a4d-9b66-e491971a9bbb tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.270923 Sep 09 21:28:34.882675 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 171/331] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:34 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:35.047393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d3980d26-0f1f-44f9-a031-e3f566860c74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:35.053218 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:35.056376 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d3980d26-0f1f-44f9-a031-e3f566860c74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1371 microversion: 2.1 time: 0.586077 Sep 09 21:28:35.063578 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 161/332] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:34 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1371 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:35.561008 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-9069c37c-9754-4e14-a992-b4343c7d3fea req-e728fba2-f5ec-438b-81ec-ad3dcf0fe1bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bb0cf9-68da-449d-bdbd-d8c1aa49dc96", "tag": "9163f46b-8a4c-44b4-a67e-f7a360441df7"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:35.571897 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-9069c37c-9754-4e14-a992-b4343c7d3fea req-e728fba2-f5ec-438b-81ec-ad3dcf0fe1bc service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:35.572505 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-9069c37c-9754-4e14-a992-b4343c7d3fea req-e728fba2-f5ec-438b-81ec-ad3dcf0fe1bc service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:35.572948 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-9069c37c-9754-4e14-a992-b4343c7d3fea req-e728fba2-f5ec-438b-81ec-ad3dcf0fe1bc service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:35.585689 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-9069c37c-9754-4e14-a992-b4343c7d3fea req-e728fba2-f5ec-438b-81ec-ad3dcf0fe1bc service nova] Creating event network-changed:9163f46b-8a4c-44b4-a67e-f7a360441df7 for instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 on hv-cinder-85221 Sep 09 21:28:35.594318 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-9069c37c-9754-4e14-a992-b4343c7d3fea req-e728fba2-f5ec-438b-81ec-ad3dcf0fe1bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036601 Sep 09 21:28:35.596260 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 172/333] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:28:35.647054 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:35.647717 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:35.661438 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:35.662482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:35.663280 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:35.664714 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:35.666093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:35.667509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:35.865232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:35.873555 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:35.875654 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:35.878302 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6a986b0d-b7d3-47ff-9f33-c02c3c2d4e2b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1746 microversion: 2.20 time: 0.241361 Sep 09 21:28:35.878979 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 162/334] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:35 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1746 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:35.911210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a5173496-9d8c-46cb-8f2b-6466cb0bc806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:35.911914 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a5173496-9d8c-46cb-8f2b-6466cb0bc806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:35.918364 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a5173496-9d8c-46cb-8f2b-6466cb0bc806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:35.919129 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a5173496-9d8c-46cb-8f2b-6466cb0bc806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:35.920330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a5173496-9d8c-46cb-8f2b-6466cb0bc806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:35.921321 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a5173496-9d8c-46cb-8f2b-6466cb0bc806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:35.922422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a5173496-9d8c-46cb-8f2b-6466cb0bc806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:35.923102 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a5173496-9d8c-46cb-8f2b-6466cb0bc806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:36.085270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3a058391-31e8-49f1-9c31-accb746dab1c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:36.086157 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3a058391-31e8-49f1-9c31-accb746dab1c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:36.089377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a5173496-9d8c-46cb-8f2b-6466cb0bc806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:36.092815 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a058391-31e8-49f1-9c31-accb746dab1c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:36.093445 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a058391-31e8-49f1-9c31-accb746dab1c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:36.094127 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a058391-31e8-49f1-9c31-accb746dab1c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:36.095789 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a058391-31e8-49f1-9c31-accb746dab1c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:36.096656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a058391-31e8-49f1-9c31-accb746dab1c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:36.097383 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a058391-31e8-49f1-9c31-accb746dab1c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:36.101705 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a5173496-9d8c-46cb-8f2b-6466cb0bc806 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.194838 Sep 09 21:28:36.102426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 173/335] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:35 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:36.323136 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-3a058391-31e8-49f1-9c31-accb746dab1c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:36.332606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3a058391-31e8-49f1-9c31-accb746dab1c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1371 microversion: 2.1 time: 0.250977 Sep 09 21:28:36.346526 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 163/336] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:36 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:36.382338 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-bae3f436-51e7-46fe-bd91-8ffda9d6a8f3 req-7fff5b96-46ec-4586-af0a-20621d51bb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8f74a7-256c-4810-944b-e4f66773aa13", "name": "network-vif-plugged", "status": "completed", "tag": "b28ee03c-d6a8-454c-b9c8-a9a10b589dbc"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:36.392042 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-bae3f436-51e7-46fe-bd91-8ffda9d6a8f3 req-7fff5b96-46ec-4586-af0a-20621d51bb92 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:36.393117 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-bae3f436-51e7-46fe-bd91-8ffda9d6a8f3 req-7fff5b96-46ec-4586-af0a-20621d51bb92 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:36.393559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-bae3f436-51e7-46fe-bd91-8ffda9d6a8f3 req-7fff5b96-46ec-4586-af0a-20621d51bb92 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:36.404650 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-bae3f436-51e7-46fe-bd91-8ffda9d6a8f3 req-7fff5b96-46ec-4586-af0a-20621d51bb92 service nova] Creating event network-vif-plugged:b28ee03c-d6a8-454c-b9c8-a9a10b589dbc for instance cb8f74a7-256c-4810-944b-e4f66773aa13 on hv-cinder-85221 Sep 09 21:28:36.410028 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-bae3f436-51e7-46fe-bd91-8ffda9d6a8f3 req-7fff5b96-46ec-4586-af0a-20621d51bb92 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032480 Sep 09 21:28:36.410604 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 174/337] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:28:36.904398 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:36.904973 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:36.912952 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:36.913454 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:36.913897 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:36.914595 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:36.915050 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:36.915475 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:37.050098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:37.058098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:37.059545 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:37.060704 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-40594b22-a228-4de1-aa53-828b3bb4e29e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1746 microversion: 2.20 time: 0.160387 Sep 09 21:28:37.061256 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 164/338] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:36 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:37.128134 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ac8fc494-03ce-4ea1-b608-ec9b28cae99e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:37.129021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ac8fc494-03ce-4ea1-b608-ec9b28cae99e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:37.135229 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac8fc494-03ce-4ea1-b608-ec9b28cae99e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:37.135756 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac8fc494-03ce-4ea1-b608-ec9b28cae99e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:37.136192 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac8fc494-03ce-4ea1-b608-ec9b28cae99e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:37.136874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac8fc494-03ce-4ea1-b608-ec9b28cae99e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:37.137334 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac8fc494-03ce-4ea1-b608-ec9b28cae99e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:37.137761 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac8fc494-03ce-4ea1-b608-ec9b28cae99e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:37.272856 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ac8fc494-03ce-4ea1-b608-ec9b28cae99e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:37.280989 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ac8fc494-03ce-4ea1-b608-ec9b28cae99e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.158383 Sep 09 21:28:37.281581 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 175/339] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:37 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:37.355650 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1d794813-b558-49bb-9237-f85509e28511 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:37.356266 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1d794813-b558-49bb-9237-f85509e28511 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:37.362478 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d794813-b558-49bb-9237-f85509e28511 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:37.362964 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d794813-b558-49bb-9237-f85509e28511 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:37.363395 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d794813-b558-49bb-9237-f85509e28511 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:37.364099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d794813-b558-49bb-9237-f85509e28511 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:37.364554 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d794813-b558-49bb-9237-f85509e28511 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:37.364976 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d794813-b558-49bb-9237-f85509e28511 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:37.505698 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1d794813-b558-49bb-9237-f85509e28511 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:37.515992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1d794813-b558-49bb-9237-f85509e28511 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1371 microversion: 2.1 time: 0.161546 Sep 09 21:28:37.515992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 165/340] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:37 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:38.089070 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:38.089780 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:38.101426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:38.101917 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:38.102350 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:38.103039 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:38.103524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:38.103958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:38.238975 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:38.248100 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:38.249542 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:38.250705 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-be85d66b-9147-473b-9c66-a31dfb5c7e10 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1746 microversion: 2.20 time: 0.165997 Sep 09 21:28:38.251292 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 176/341] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:38 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:38.304605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d90cfc37-1352-47e9-aa80-16bad6598a97 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:38.305167 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d90cfc37-1352-47e9-aa80-16bad6598a97 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:38.311836 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d90cfc37-1352-47e9-aa80-16bad6598a97 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:38.312372 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d90cfc37-1352-47e9-aa80-16bad6598a97 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:38.312806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d90cfc37-1352-47e9-aa80-16bad6598a97 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:38.313598 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d90cfc37-1352-47e9-aa80-16bad6598a97 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:38.314076 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d90cfc37-1352-47e9-aa80-16bad6598a97 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:38.314501 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d90cfc37-1352-47e9-aa80-16bad6598a97 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:38.449782 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d90cfc37-1352-47e9-aa80-16bad6598a97 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:38.458795 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d90cfc37-1352-47e9-aa80-16bad6598a97 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.158318 Sep 09 21:28:38.459358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 166/342] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:38 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:38.536523 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-78bdaeca-d77b-4189-9dbf-a88847ba5a42 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:38.537136 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-78bdaeca-d77b-4189-9dbf-a88847ba5a42 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:38.542955 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-78bdaeca-d77b-4189-9dbf-a88847ba5a42 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:38.543444 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-78bdaeca-d77b-4189-9dbf-a88847ba5a42 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:38.543909 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-78bdaeca-d77b-4189-9dbf-a88847ba5a42 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:38.544597 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-78bdaeca-d77b-4189-9dbf-a88847ba5a42 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:38.545054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-78bdaeca-d77b-4189-9dbf-a88847ba5a42 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:38.545483 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-78bdaeca-d77b-4189-9dbf-a88847ba5a42 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:38.697772 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-273117676", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-10145937", "security_groups": [{"name": "tempest-secgroup-smoke-648170489"}], "networks": [{"uuid": "2f46706e-0418-4180-9a67-0d977f4a43b5"}], "block_device_mapping_v2": [{"uuid": "d7999d9f-55cf-423e-82ac-fc353dfc5068", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:38.701827 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-78bdaeca-d77b-4189-9dbf-a88847ba5a42 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:38.715588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-78bdaeca-d77b-4189-9dbf-a88847ba5a42 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1371 microversion: 2.1 time: 0.183126 Sep 09 21:28:38.716765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 177/343] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:38 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:38.821965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] validate_networks() for [('2f46706e-0418-4180-9a67-0d977f4a43b5', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:28:39.280577 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:39.281845 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:39.289444 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:28:39.290089 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:39.290583 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:39.291023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:39.291137 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:28:39.291756 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:39.292215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:39.292640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:39.296882 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:28:39.297407 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:28:39.297827 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:28:39.310571 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:39.311233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:39.311720 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:39.312511 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:39.313034 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:39.313527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:39.332733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Getting quotas for project e46e2167ee15481fab472e5b101c9c60. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:28:39.337035 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Getting quotas for user 469561e39c274301b16677d12cac3a67 and project e46e2167ee15481fab472e5b101c9c60. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:28:39.405986 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:28:39.409600 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d7999d9f-55cf-423e-82ac-fc353dfc5068',volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:28:39.543215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:39.552742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:39.555261 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:39.556891 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b3d60301-b215-47c2-a934-acf5b7dd96fe tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1746 microversion: 2.20 time: 0.283749 Sep 09 21:28:39.558162 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 178/344] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:39 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1746 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:39.568136 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-28cd73d3-1475-4769-bdc6-aac528431fe2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:39.569100 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-28cd73d3-1475-4769-bdc6-aac528431fe2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:39.582054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-28cd73d3-1475-4769-bdc6-aac528431fe2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:39.582760 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-28cd73d3-1475-4769-bdc6-aac528431fe2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:39.583376 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-28cd73d3-1475-4769-bdc6-aac528431fe2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:39.584129 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-28cd73d3-1475-4769-bdc6-aac528431fe2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:39.584599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-28cd73d3-1475-4769-bdc6-aac528431fe2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:39.585032 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-28cd73d3-1475-4769-bdc6-aac528431fe2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:39.650215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1a96cfe8-1655-4f37-b6be-a3ea14a0a8d7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.956636 Sep 09 21:28:39.651161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 167/345] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:28:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:28:39.666616 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-43a288a8-332f-474d-b3d4-148983e851f7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:39.667576 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-43a288a8-332f-474d-b3d4-148983e851f7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:39.794430 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-43a288a8-332f-474d-b3d4-148983e851f7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:39.795627 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-43a288a8-332f-474d-b3d4-148983e851f7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1086 microversion: 2.1 time: 0.134506 Sep 09 21:28:39.797482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 168/346] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:39 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1086 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:39.808918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-54457a54-f3eb-49d7-a6ac-782f5fd52b0c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:39.809770 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-54457a54-f3eb-49d7-a6ac-782f5fd52b0c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:39.819202 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:39.829100 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54457a54-f3eb-49d7-a6ac-782f5fd52b0c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:39.830283 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54457a54-f3eb-49d7-a6ac-782f5fd52b0c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:39.830733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54457a54-f3eb-49d7-a6ac-782f5fd52b0c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:39.831460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54457a54-f3eb-49d7-a6ac-782f5fd52b0c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:39.831983 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54457a54-f3eb-49d7-a6ac-782f5fd52b0c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:39.832367 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54457a54-f3eb-49d7-a6ac-782f5fd52b0c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:39.844893 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=6 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:39.882921 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-28cd73d3-1475-4769-bdc6-aac528431fe2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:39.894836 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-28cd73d3-1475-4769-bdc6-aac528431fe2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.335328 Sep 09 21:28:39.895996 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 179/347] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:39 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:40.436417 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-54457a54-f3eb-49d7-a6ac-782f5fd52b0c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:40.445287 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-54457a54-f3eb-49d7-a6ac-782f5fd52b0c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1371 microversion: 2.1 time: 0.646754 Sep 09 21:28:40.445868 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 169/348] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:39 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1371 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:40.587636 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:40.588376 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:40.594707 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:40.595810 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:40.596425 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:40.597124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:40.597591 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:40.598022 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:40.770963 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:40.779140 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:40.780605 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:40.781745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-10cc62a0-b979-4380-8ee1-9337c7161806 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1746 microversion: 2.20 time: 0.198679 Sep 09 21:28:40.782302 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 180/349] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:40 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1746 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:28:40.827930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d5e03a94-34b7-41c7-9985-512165dacecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:40.828631 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d5e03a94-34b7-41c7-9985-512165dacecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:40.836657 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5e03a94-34b7-41c7-9985-512165dacecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:40.837156 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5e03a94-34b7-41c7-9985-512165dacecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:40.837597 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5e03a94-34b7-41c7-9985-512165dacecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:40.838290 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5e03a94-34b7-41c7-9985-512165dacecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:40.838747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5e03a94-34b7-41c7-9985-512165dacecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:40.839364 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5e03a94-34b7-41c7-9985-512165dacecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:40.910727 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d5e03a94-34b7-41c7-9985-512165dacecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:40.920678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-75ac06de-a556-41a3-92d4-acd801a58906 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:40.921655 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-75ac06de-a556-41a3-92d4-acd801a58906 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:40.923231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d5e03a94-34b7-41c7-9985-512165dacecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1184 microversion: 2.1 time: 0.100034 Sep 09 21:28:40.924335 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 170/350] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:40 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1184 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:40.946438 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75ac06de-a556-41a3-92d4-acd801a58906 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:40.947522 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75ac06de-a556-41a3-92d4-acd801a58906 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:40.948247 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75ac06de-a556-41a3-92d4-acd801a58906 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:40.949037 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75ac06de-a556-41a3-92d4-acd801a58906 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:40.949624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75ac06de-a556-41a3-92d4-acd801a58906 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:40.950122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75ac06de-a556-41a3-92d4-acd801a58906 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:41.111840 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-75ac06de-a556-41a3-92d4-acd801a58906 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:41.121021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-75ac06de-a556-41a3-92d4-acd801a58906 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.204471 Sep 09 21:28:41.121590 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 181/351] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:40 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:41.473187 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-fef2c773-5ab2-4de0-8c35-7b0b309bb787 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:41.473678 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-fef2c773-5ab2-4de0-8c35-7b0b309bb787 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:41.482473 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fef2c773-5ab2-4de0-8c35-7b0b309bb787 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:41.482972 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fef2c773-5ab2-4de0-8c35-7b0b309bb787 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:41.483410 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fef2c773-5ab2-4de0-8c35-7b0b309bb787 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:41.484139 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fef2c773-5ab2-4de0-8c35-7b0b309bb787 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:41.484598 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fef2c773-5ab2-4de0-8c35-7b0b309bb787 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:41.489110 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fef2c773-5ab2-4de0-8c35-7b0b309bb787 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:41.714577 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-fef2c773-5ab2-4de0-8c35-7b0b309bb787 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:41.727101 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-fef2c773-5ab2-4de0-8c35-7b0b309bb787 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1371 microversion: 2.1 time: 0.259173 Sep 09 21:28:41.744220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 171/352] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:41 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:41.809609 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:41.810304 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:41.817674 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:41.818085 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:41.818525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:41.819220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:41.820052 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:41.820489 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:41.951206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5c5169df-9503-4131-856a-a595c22180ef tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:41.952185 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5c5169df-9503-4131-856a-a595c22180ef tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:41.965839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c5169df-9503-4131-856a-a595c22180ef tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:41.965839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c5169df-9503-4131-856a-a595c22180ef tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:41.965839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c5169df-9503-4131-856a-a595c22180ef tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:41.965839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c5169df-9503-4131-856a-a595c22180ef tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:41.982708 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c5169df-9503-4131-856a-a595c22180ef tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:41.983231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c5169df-9503-4131-856a-a595c22180ef tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:41.992612 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:42.003163 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:42.006504 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:42.007749 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-af9dfa53-6c3b-4546-8d9c-4f3af81afdbd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1746 microversion: 2.20 time: 0.203002 Sep 09 21:28:42.009066 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 182/353] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:41 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1746 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:42.119933 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5c5169df-9503-4131-856a-a595c22180ef tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:42.134268 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5c5169df-9503-4131-856a-a595c22180ef tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1202 microversion: 2.1 time: 0.187484 Sep 09 21:28:42.148511 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 172/354] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:41 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1202 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:42.152762 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-fe433002-0de9-4856-ad3d-c0f69fac4a62 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:42.153548 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-fe433002-0de9-4856-ad3d-c0f69fac4a62 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:42.169562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe433002-0de9-4856-ad3d-c0f69fac4a62 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:42.170602 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe433002-0de9-4856-ad3d-c0f69fac4a62 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:42.171290 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe433002-0de9-4856-ad3d-c0f69fac4a62 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:42.172304 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe433002-0de9-4856-ad3d-c0f69fac4a62 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:42.179336 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe433002-0de9-4856-ad3d-c0f69fac4a62 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:42.179726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe433002-0de9-4856-ad3d-c0f69fac4a62 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:42.405224 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-fe433002-0de9-4856-ad3d-c0f69fac4a62 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:42.418732 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-fe433002-0de9-4856-ad3d-c0f69fac4a62 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.275175 Sep 09 21:28:42.419329 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 183/355] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:42 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:42.590943 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-b8bff030-0b57-43c2-b063-1506d59a4237 req-c35b2a1e-d06c-4449-a39b-659b21779f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bb0cf9-68da-449d-bdbd-d8c1aa49dc96", "name": "network-vif-plugged", "status": "completed", "tag": "9163f46b-8a4c-44b4-a67e-f7a360441df7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:42.632622 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8bff030-0b57-43c2-b063-1506d59a4237 req-c35b2a1e-d06c-4449-a39b-659b21779f13 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:42.635188 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8bff030-0b57-43c2-b063-1506d59a4237 req-c35b2a1e-d06c-4449-a39b-659b21779f13 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:42.642847 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8bff030-0b57-43c2-b063-1506d59a4237 req-c35b2a1e-d06c-4449-a39b-659b21779f13 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:42.680444 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-b8bff030-0b57-43c2-b063-1506d59a4237 req-c35b2a1e-d06c-4449-a39b-659b21779f13 service nova] Creating event network-vif-plugged:9163f46b-8a4c-44b4-a67e-f7a360441df7 for instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 on hv-cinder-85221 Sep 09 21:28:42.694524 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-b8bff030-0b57-43c2-b063-1506d59a4237 req-c35b2a1e-d06c-4449-a39b-659b21779f13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106966 Sep 09 21:28:42.701399 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 173/356] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:28:42.754873 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-14885522-f36e-48de-8421-2c4495c13035 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:42.755778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-14885522-f36e-48de-8421-2c4495c13035 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:42.766385 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-14885522-f36e-48de-8421-2c4495c13035 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:42.768671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-14885522-f36e-48de-8421-2c4495c13035 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:42.769282 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-14885522-f36e-48de-8421-2c4495c13035 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:42.773511 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-14885522-f36e-48de-8421-2c4495c13035 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:42.776395 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-14885522-f36e-48de-8421-2c4495c13035 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:42.777488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-14885522-f36e-48de-8421-2c4495c13035 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:43.047570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:43.048623 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:43.057389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:43.058118 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:43.058759 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:43.059683 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:43.060326 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:43.060949 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:43.139269 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-14885522-f36e-48de-8421-2c4495c13035 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:43.149926 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-14885522-f36e-48de-8421-2c4495c13035 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1371 microversion: 2.1 time: 0.399771 Sep 09 21:28:43.154643 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 184/357] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:42 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:43.169800 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-650aad73-2f0a-4fb3-a0f0-c1aea4c705df tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:43.170416 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-650aad73-2f0a-4fb3-a0f0-c1aea4c705df tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:43.176735 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-650aad73-2f0a-4fb3-a0f0-c1aea4c705df tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:43.177228 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-650aad73-2f0a-4fb3-a0f0-c1aea4c705df tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:43.177929 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-650aad73-2f0a-4fb3-a0f0-c1aea4c705df tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:43.178638 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-650aad73-2f0a-4fb3-a0f0-c1aea4c705df tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:43.179110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-650aad73-2f0a-4fb3-a0f0-c1aea4c705df tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:43.179552 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-650aad73-2f0a-4fb3-a0f0-c1aea4c705df tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:43.335717 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-650aad73-2f0a-4fb3-a0f0-c1aea4c705df tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:43.344638 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-650aad73-2f0a-4fb3-a0f0-c1aea4c705df tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.179602 Sep 09 21:28:43.346343 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 185/358] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:43 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:43.442131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-814b84be-5b16-4f87-868c-6a43311af22c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:43.442777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-814b84be-5b16-4f87-868c-6a43311af22c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:43.450490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-814b84be-5b16-4f87-868c-6a43311af22c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:43.451321 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-814b84be-5b16-4f87-868c-6a43311af22c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:43.452174 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-814b84be-5b16-4f87-868c-6a43311af22c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:43.453110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-814b84be-5b16-4f87-868c-6a43311af22c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:43.453836 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-814b84be-5b16-4f87-868c-6a43311af22c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:43.455429 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-814b84be-5b16-4f87-868c-6a43311af22c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:43.498970 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:43.522365 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:43.524868 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:43.526323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-75590f7a-03a8-4781-b81b-e3f9a7e24461 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.490720 Sep 09 21:28:43.535259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 174/359] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:43 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:43.540498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1586981291", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:43.631995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] validate_networks() for None {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:28:43.697373 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-814b84be-5b16-4f87-868c-6a43311af22c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:43.708159 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-814b84be-5b16-4f87-868c-6a43311af22c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.269741 Sep 09 21:28:43.709031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 186/360] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:43 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:44.148252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:28:44.149149 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:28:44.149924 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:28:44.150557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:28:44.150979 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:28:44.161307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.162093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.162697 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.163826 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.164480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.165070 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.176412 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4458f1dd-4e7c-4d03-b049-c98a108a2469 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:44.177640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4458f1dd-4e7c-4d03-b049-c98a108a2469 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:44.189986 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4458f1dd-4e7c-4d03-b049-c98a108a2469 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.190898 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4458f1dd-4e7c-4d03-b049-c98a108a2469 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.191512 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4458f1dd-4e7c-4d03-b049-c98a108a2469 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.192459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4458f1dd-4e7c-4d03-b049-c98a108a2469 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.194931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4458f1dd-4e7c-4d03-b049-c98a108a2469 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.195369 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4458f1dd-4e7c-4d03-b049-c98a108a2469 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.216764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Getting quotas for project 767cd74e36bf4ebb8e30b6f82d2a9164. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:28:44.226557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Getting quotas for user 95558d9a28bf4a0bac9dd72445999781 and project 767cd74e36bf4ebb8e30b6f82d2a9164. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:28:44.267914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:28:44.270596 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:28:44.327999 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-14e91d2d-0846-48d8-84a0-7ede2264deb5 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791099 Sep 09 21:28:44.328752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 175/361] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:28:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:28:44.348580 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-11a4dcd2-c248-4f36-a066-b8cbdff81ace tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:44.349446 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-11a4dcd2-c248-4f36-a066-b8cbdff81ace tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:44.419068 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-11a4dcd2-c248-4f36-a066-b8cbdff81ace tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:44.431130 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-11a4dcd2-c248-4f36-a066-b8cbdff81ace tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1215 microversion: 2.1 time: 0.090913 Sep 09 21:28:44.431792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 176/362] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:44 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:44.438331 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4458f1dd-4e7c-4d03-b049-c98a108a2469 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:44.452742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4458f1dd-4e7c-4d03-b049-c98a108a2469 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1371 microversion: 2.1 time: 0.281684 Sep 09 21:28:44.467096 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-548f1f83-d932-44e0-9239-0c9cd81b422a req-12fa6fec-4ee9-42a8-8e04-0b4cbc1e7b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c0a8dd3-202a-407d-ae71-aab47f86d6f5", "tag": "7a98c16e-6360-4bb7-9f82-5a8d9091e05f"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:44.471647 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 187/363] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:44 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:44.476519 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-10f51c13-0d03-403e-89f3-27706089cf7e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:44.478188 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-548f1f83-d932-44e0-9239-0c9cd81b422a req-12fa6fec-4ee9-42a8-8e04-0b4cbc1e7b4d service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.478683 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-548f1f83-d932-44e0-9239-0c9cd81b422a req-12fa6fec-4ee9-42a8-8e04-0b4cbc1e7b4d service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.479119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-548f1f83-d932-44e0-9239-0c9cd81b422a req-12fa6fec-4ee9-42a8-8e04-0b4cbc1e7b4d service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.480397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-10f51c13-0d03-403e-89f3-27706089cf7e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:44.489703 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10f51c13-0d03-403e-89f3-27706089cf7e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.490957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10f51c13-0d03-403e-89f3-27706089cf7e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.491081 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-548f1f83-d932-44e0-9239-0c9cd81b422a req-12fa6fec-4ee9-42a8-8e04-0b4cbc1e7b4d service nova] Creating event network-changed:7a98c16e-6360-4bb7-9f82-5a8d9091e05f for instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 on hv-cinder-85221 Sep 09 21:28:44.491984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10f51c13-0d03-403e-89f3-27706089cf7e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.495150 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10f51c13-0d03-403e-89f3-27706089cf7e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.496110 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-548f1f83-d932-44e0-9239-0c9cd81b422a req-12fa6fec-4ee9-42a8-8e04-0b4cbc1e7b4d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063077 Sep 09 21:28:44.496282 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10f51c13-0d03-403e-89f3-27706089cf7e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.496892 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 177/364] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:28:44.497567 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-10f51c13-0d03-403e-89f3-27706089cf7e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.565280 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:44.566694 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:44.587976 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.588499 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.589103 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.589871 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.590696 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.591466 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.761024 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-10f51c13-0d03-403e-89f3-27706089cf7e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:44.785439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-10f51c13-0d03-403e-89f3-27706089cf7e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.312523 Sep 09 21:28:44.796700 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 188/365] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:44 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:44.810333 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-dab2e66d-6d15-4e50-b456-a2e321078c2d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:44.813416 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-dab2e66d-6d15-4e50-b456-a2e321078c2d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:44.826892 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dab2e66d-6d15-4e50-b456-a2e321078c2d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.827634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dab2e66d-6d15-4e50-b456-a2e321078c2d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.828275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dab2e66d-6d15-4e50-b456-a2e321078c2d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.829761 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dab2e66d-6d15-4e50-b456-a2e321078c2d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:44.830410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dab2e66d-6d15-4e50-b456-a2e321078c2d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:44.831204 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dab2e66d-6d15-4e50-b456-a2e321078c2d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:44.858759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=100 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:44.953879 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:44.975150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:44.983042 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:44.988791 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-33b14729-cb7b-4add-85be-7e0eeb6b07c6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.430166 Sep 09 21:28:44.991776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 178/366] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:44 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:45.062544 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-dab2e66d-6d15-4e50-b456-a2e321078c2d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:45.077602 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-dab2e66d-6d15-4e50-b456-a2e321078c2d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.279564 Sep 09 21:28:45.093010 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 189/367] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:44 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:45.459137 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a4f86417-56bb-466f-a3b3-a20246981be9 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:45.462388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a4f86417-56bb-466f-a3b3-a20246981be9 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:45.474853 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4f86417-56bb-466f-a3b3-a20246981be9 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:45.476307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4f86417-56bb-466f-a3b3-a20246981be9 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:45.477207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4f86417-56bb-466f-a3b3-a20246981be9 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:45.477528 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1c31f3ef-ece0-41a4-a2f6-c6e528aaafc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:45.478978 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4f86417-56bb-466f-a3b3-a20246981be9 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:45.479542 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1c31f3ef-ece0-41a4-a2f6-c6e528aaafc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:45.480099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4f86417-56bb-466f-a3b3-a20246981be9 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:45.480878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4f86417-56bb-466f-a3b3-a20246981be9 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:45.495014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c31f3ef-ece0-41a4-a2f6-c6e528aaafc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:45.495657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c31f3ef-ece0-41a4-a2f6-c6e528aaafc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:45.496267 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c31f3ef-ece0-41a4-a2f6-c6e528aaafc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:45.497060 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c31f3ef-ece0-41a4-a2f6-c6e528aaafc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:45.497532 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c31f3ef-ece0-41a4-a2f6-c6e528aaafc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:45.497981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c31f3ef-ece0-41a4-a2f6-c6e528aaafc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:45.592318 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a4f86417-56bb-466f-a3b3-a20246981be9 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:45.603164 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a4f86417-56bb-466f-a3b3-a20246981be9 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1219 microversion: 2.1 time: 0.150501 Sep 09 21:28:45.606692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 179/368] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:45 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:45.690144 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1c31f3ef-ece0-41a4-a2f6-c6e528aaafc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:45.701145 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1c31f3ef-ece0-41a4-a2f6-c6e528aaafc5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1371 microversion: 2.1 time: 0.227573 Sep 09 21:28:45.702419 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 190/369] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:45 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:45.809929 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5100d9ea-3955-4237-adbe-20b9be30966e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:45.811462 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5100d9ea-3955-4237-adbe-20b9be30966e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:45.820952 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5100d9ea-3955-4237-adbe-20b9be30966e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:45.821616 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5100d9ea-3955-4237-adbe-20b9be30966e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:45.822314 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5100d9ea-3955-4237-adbe-20b9be30966e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:45.823240 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5100d9ea-3955-4237-adbe-20b9be30966e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:45.823837 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5100d9ea-3955-4237-adbe-20b9be30966e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:45.824672 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5100d9ea-3955-4237-adbe-20b9be30966e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:46.024090 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:46.024958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:46.038542 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:46.041544 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:46.042466 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:46.043706 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:46.044344 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:46.044955 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:46.087685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5100d9ea-3955-4237-adbe-20b9be30966e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:46.104027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5100d9ea-3955-4237-adbe-20b9be30966e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.294270 Sep 09 21:28:46.105017 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 180/370] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:45 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:46.141877 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e2964256-abc1-4b3e-8248-f2a4d5fc5793 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:46.143057 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e2964256-abc1-4b3e-8248-f2a4d5fc5793 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:46.156452 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e2964256-abc1-4b3e-8248-f2a4d5fc5793 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:46.158196 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e2964256-abc1-4b3e-8248-f2a4d5fc5793 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:46.159265 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e2964256-abc1-4b3e-8248-f2a4d5fc5793 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:46.160367 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e2964256-abc1-4b3e-8248-f2a4d5fc5793 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:46.161183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e2964256-abc1-4b3e-8248-f2a4d5fc5793 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:46.161839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e2964256-abc1-4b3e-8248-f2a4d5fc5793 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:46.302701 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:46.313311 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:46.317164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:46.318901 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4bed4957-2150-492a-9c71-bdc9a3f2749c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.301188 Sep 09 21:28:46.319976 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 191/371] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:46 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:46.474346 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e2964256-abc1-4b3e-8248-f2a4d5fc5793 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:46.486232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e2964256-abc1-4b3e-8248-f2a4d5fc5793 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.378406 Sep 09 21:28:46.503775 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 181/372] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:46 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:46.639688 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-dcc0cd99-6f51-478f-b716-dbe44ddf2741 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:46.641257 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-dcc0cd99-6f51-478f-b716-dbe44ddf2741 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:46.655086 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dcc0cd99-6f51-478f-b716-dbe44ddf2741 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:46.656007 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dcc0cd99-6f51-478f-b716-dbe44ddf2741 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:46.656915 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dcc0cd99-6f51-478f-b716-dbe44ddf2741 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:46.671259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dcc0cd99-6f51-478f-b716-dbe44ddf2741 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:46.672063 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dcc0cd99-6f51-478f-b716-dbe44ddf2741 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:46.672624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dcc0cd99-6f51-478f-b716-dbe44ddf2741 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:46.727654 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-938d2579-189b-4c7a-813b-085d4167bf7e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:46.728671 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-938d2579-189b-4c7a-813b-085d4167bf7e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:46.740585 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-938d2579-189b-4c7a-813b-085d4167bf7e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:46.743077 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-938d2579-189b-4c7a-813b-085d4167bf7e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:46.745262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-938d2579-189b-4c7a-813b-085d4167bf7e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:46.750586 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-938d2579-189b-4c7a-813b-085d4167bf7e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:46.752291 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-938d2579-189b-4c7a-813b-085d4167bf7e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:46.753042 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-938d2579-189b-4c7a-813b-085d4167bf7e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:46.807803 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-dcc0cd99-6f51-478f-b716-dbe44ddf2741 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:46.820608 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-dcc0cd99-6f51-478f-b716-dbe44ddf2741 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1267 microversion: 2.1 time: 0.189909 Sep 09 21:28:46.821596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 192/373] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:46 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:47.135382 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8bb35723-af9a-4908-8aaf-09de93b2b00e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:47.139068 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8bb35723-af9a-4908-8aaf-09de93b2b00e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:47.152977 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8bb35723-af9a-4908-8aaf-09de93b2b00e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:47.153482 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8bb35723-af9a-4908-8aaf-09de93b2b00e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:47.154475 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8bb35723-af9a-4908-8aaf-09de93b2b00e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:47.164794 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8bb35723-af9a-4908-8aaf-09de93b2b00e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:47.165836 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8bb35723-af9a-4908-8aaf-09de93b2b00e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:47.166545 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8bb35723-af9a-4908-8aaf-09de93b2b00e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:47.219242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-938d2579-189b-4c7a-813b-085d4167bf7e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:47.243091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-938d2579-189b-4c7a-813b-085d4167bf7e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1564 microversion: 2.1 time: 0.521385 Sep 09 21:28:47.258241 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 182/374] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:46 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1564 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:47.280835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a4b4204c-65d8-4237-80da-c6d637b9bee9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:47.281649 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a4b4204c-65d8-4237-80da-c6d637b9bee9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:47.310433 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4b4204c-65d8-4237-80da-c6d637b9bee9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:47.310433 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4b4204c-65d8-4237-80da-c6d637b9bee9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:47.310433 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4b4204c-65d8-4237-80da-c6d637b9bee9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:47.310433 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4b4204c-65d8-4237-80da-c6d637b9bee9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:47.310879 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4b4204c-65d8-4237-80da-c6d637b9bee9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:47.310879 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4b4204c-65d8-4237-80da-c6d637b9bee9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:47.315218 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=100 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:47.397313 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8bb35723-af9a-4908-8aaf-09de93b2b00e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:47.407962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8bb35723-af9a-4908-8aaf-09de93b2b00e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.276421 Sep 09 21:28:47.409298 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 193/375] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:47 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:47.413175 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a4b4204c-65d8-4237-80da-c6d637b9bee9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146623 Sep 09 21:28:47.414484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:47.415255 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:47.416654 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 183/376] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 21:28:47 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:28:47.421959 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:47.422689 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:47.424306 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:47.434294 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:47.434810 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:47.435254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:47.519940 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-25ebdc8d-04ed-40fb-a6f7-856b5037efd1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:47.520903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-25ebdc8d-04ed-40fb-a6f7-856b5037efd1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:47.527741 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25ebdc8d-04ed-40fb-a6f7-856b5037efd1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:47.528587 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25ebdc8d-04ed-40fb-a6f7-856b5037efd1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:47.529227 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25ebdc8d-04ed-40fb-a6f7-856b5037efd1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:47.530306 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25ebdc8d-04ed-40fb-a6f7-856b5037efd1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:47.530964 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25ebdc8d-04ed-40fb-a6f7-856b5037efd1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:47.531607 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25ebdc8d-04ed-40fb-a6f7-856b5037efd1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:47.681929 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:47.696870 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:47.698326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:47.699498 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-af2b00c8-c771-4562-8b5d-34dfa4065f9c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.288936 Sep 09 21:28:47.706491 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 194/377] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:47 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:47.729674 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-25ebdc8d-04ed-40fb-a6f7-856b5037efd1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:47.744574 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-25ebdc8d-04ed-40fb-a6f7-856b5037efd1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1724 microversion: 2.1 time: 0.229180 Sep 09 21:28:47.758477 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 184/378] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:47 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:47.848558 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d0a7ea08-5c26-4c9f-bed9-77c6787b8166 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:47.849094 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d0a7ea08-5c26-4c9f-bed9-77c6787b8166 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:47.855445 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0a7ea08-5c26-4c9f-bed9-77c6787b8166 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:47.856378 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0a7ea08-5c26-4c9f-bed9-77c6787b8166 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:47.856990 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0a7ea08-5c26-4c9f-bed9-77c6787b8166 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:47.857882 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0a7ea08-5c26-4c9f-bed9-77c6787b8166 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:47.858336 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0a7ea08-5c26-4c9f-bed9-77c6787b8166 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:47.858939 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0a7ea08-5c26-4c9f-bed9-77c6787b8166 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:47.941628 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d0a7ea08-5c26-4c9f-bed9-77c6787b8166 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:47.957308 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d0a7ea08-5c26-4c9f-bed9-77c6787b8166 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1273 microversion: 2.1 time: 0.112309 Sep 09 21:28:47.975349 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 195/379] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:47 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:48.435992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-806dbd93-7620-4683-b5f7-570ac47b4cf3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:48.436613 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-806dbd93-7620-4683-b5f7-570ac47b4cf3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:48.456325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-806dbd93-7620-4683-b5f7-570ac47b4cf3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:48.457034 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-806dbd93-7620-4683-b5f7-570ac47b4cf3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:48.457648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-806dbd93-7620-4683-b5f7-570ac47b4cf3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:48.458538 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-806dbd93-7620-4683-b5f7-570ac47b4cf3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:48.461413 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-806dbd93-7620-4683-b5f7-570ac47b4cf3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:48.462719 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-806dbd93-7620-4683-b5f7-570ac47b4cf3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:48.731751 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:48.732513 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:48.744399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:48.744952 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:48.745393 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:48.750705 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:48.752018 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:48.752649 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:48.785054 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-806dbd93-7620-4683-b5f7-570ac47b4cf3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:48.796735 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-806dbd93-7620-4683-b5f7-570ac47b4cf3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.364422 Sep 09 21:28:48.801141 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 185/380] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:48 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:48.822707 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0857161a-e6fe-4693-94e1-8d4524caa97f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:48.823900 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0857161a-e6fe-4693-94e1-8d4524caa97f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:48.837989 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0857161a-e6fe-4693-94e1-8d4524caa97f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:48.841230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0857161a-e6fe-4693-94e1-8d4524caa97f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:48.841936 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0857161a-e6fe-4693-94e1-8d4524caa97f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:48.842999 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0857161a-e6fe-4693-94e1-8d4524caa97f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:48.843933 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0857161a-e6fe-4693-94e1-8d4524caa97f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:48.844779 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0857161a-e6fe-4693-94e1-8d4524caa97f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:49.109694 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0857161a-e6fe-4693-94e1-8d4524caa97f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:49.125110 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0857161a-e6fe-4693-94e1-8d4524caa97f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1701 microversion: 2.1 time: 0.322872 Sep 09 21:28:49.125700 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 186/381] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:48 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1701 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:49.160468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c9dc0bb8-ff4a-451a-a1b6-8f6d5761e7e6 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:49.160468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c9dc0bb8-ff4a-451a-a1b6-8f6d5761e7e6 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:49.160468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:49.175279 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9dc0bb8-ff4a-451a-a1b6-8f6d5761e7e6 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:49.178483 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9dc0bb8-ff4a-451a-a1b6-8f6d5761e7e6 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:49.178483 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9dc0bb8-ff4a-451a-a1b6-8f6d5761e7e6 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:49.178483 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9dc0bb8-ff4a-451a-a1b6-8f6d5761e7e6 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:49.178483 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9dc0bb8-ff4a-451a-a1b6-8f6d5761e7e6 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:49.179227 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9dc0bb8-ff4a-451a-a1b6-8f6d5761e7e6 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:49.280313 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c9dc0bb8-ff4a-451a-a1b6-8f6d5761e7e6 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:49.292230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c9dc0bb8-ff4a-451a-a1b6-8f6d5761e7e6 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1273 microversion: 2.1 time: 0.150310 Sep 09 21:28:49.311963 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 187/382] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:49 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:49.315766 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:49.321964 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-51eac7c9-36f6-44de-9820-bf4f031cb685 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:49.337225 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:49.339377 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-51eac7c9-36f6-44de-9820-bf4f031cb685 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:49.339940 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-51eac7c9-36f6-44de-9820-bf4f031cb685 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:49.340489 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-51eac7c9-36f6-44de-9820-bf4f031cb685 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:49.342678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:49.348988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-54cd9bc7-a9b5-4cd1-ae3c-16b142eec8a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.616763 Sep 09 21:28:49.351103 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 196/383] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:48 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:49.380756 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-51eac7c9-36f6-44de-9820-bf4f031cb685 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Going to try to start instance {{(pid=120466) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 21:28:49.405814 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-5ad4b2ad-e2cf-47df-bad9-d488be1b983c req-c07e449c-6928-4d64-936c-f2b960f6bbdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bb0cf9-68da-449d-bdbd-d8c1aa49dc96", "tag": "9163f46b-8a4c-44b4-a67e-f7a360441df7"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:49.427486 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-5ad4b2ad-e2cf-47df-bad9-d488be1b983c req-c07e449c-6928-4d64-936c-f2b960f6bbdb service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:49.428372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-5ad4b2ad-e2cf-47df-bad9-d488be1b983c req-c07e449c-6928-4d64-936c-f2b960f6bbdb service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:49.428952 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-5ad4b2ad-e2cf-47df-bad9-d488be1b983c req-c07e449c-6928-4d64-936c-f2b960f6bbdb service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:49.447393 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-5ad4b2ad-e2cf-47df-bad9-d488be1b983c req-c07e449c-6928-4d64-936c-f2b960f6bbdb service nova] Creating event network-changed:9163f46b-8a4c-44b4-a67e-f7a360441df7 for instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 on hv-cinder-85221 Sep 09 21:28:49.464721 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-5ad4b2ad-e2cf-47df-bad9-d488be1b983c req-c07e449c-6928-4d64-936c-f2b960f6bbdb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063051 Sep 09 21:28:49.466863 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 197/384] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:28:49.477248 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-51eac7c9-36f6-44de-9820-bf4f031cb685 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/action" status: 202 len: 0 microversion: 2.1 time: 0.163663 Sep 09 21:28:49.487782 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 188/385] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:28:49 2022] POST /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:28:49.488807 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9f9a13ec-6784-409b-9776-5630f2f0f84b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:49.489690 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9f9a13ec-6784-409b-9776-5630f2f0f84b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:49.496636 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f9a13ec-6784-409b-9776-5630f2f0f84b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:49.497694 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f9a13ec-6784-409b-9776-5630f2f0f84b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:49.498313 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f9a13ec-6784-409b-9776-5630f2f0f84b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:49.499262 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f9a13ec-6784-409b-9776-5630f2f0f84b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:49.499958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f9a13ec-6784-409b-9776-5630f2f0f84b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:49.500366 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f9a13ec-6784-409b-9776-5630f2f0f84b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:49.761503 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9f9a13ec-6784-409b-9776-5630f2f0f84b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:49.775170 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9f9a13ec-6784-409b-9776-5630f2f0f84b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1710 microversion: 2.1 time: 0.292716 Sep 09 21:28:49.785106 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 198/386] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:49 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1710 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:49.823895 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-753378f4-2a3f-4797-ad7d-e2d7d6445370 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:49.824809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-753378f4-2a3f-4797-ad7d-e2d7d6445370 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:49.834329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-753378f4-2a3f-4797-ad7d-e2d7d6445370 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:49.841713 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-753378f4-2a3f-4797-ad7d-e2d7d6445370 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:49.842406 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-753378f4-2a3f-4797-ad7d-e2d7d6445370 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:49.843461 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-753378f4-2a3f-4797-ad7d-e2d7d6445370 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:49.844434 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-753378f4-2a3f-4797-ad7d-e2d7d6445370 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:49.846368 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-753378f4-2a3f-4797-ad7d-e2d7d6445370 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:50.319692 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9dc422a7-b9da-4abc-940b-4f04d40bc434 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:50.320575 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9dc422a7-b9da-4abc-940b-4f04d40bc434 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:50.333272 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9dc422a7-b9da-4abc-940b-4f04d40bc434 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:50.334026 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9dc422a7-b9da-4abc-940b-4f04d40bc434 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:50.337519 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9dc422a7-b9da-4abc-940b-4f04d40bc434 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:50.338441 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9dc422a7-b9da-4abc-940b-4f04d40bc434 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:50.343107 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9dc422a7-b9da-4abc-940b-4f04d40bc434 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:50.343963 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9dc422a7-b9da-4abc-940b-4f04d40bc434 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:50.521812 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-753378f4-2a3f-4797-ad7d-e2d7d6445370 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:50.538735 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-753378f4-2a3f-4797-ad7d-e2d7d6445370 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.713828 Sep 09 21:28:50.539646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 189/387] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:49 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:50.566000 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:50.567864 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:50.584697 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:50.591967 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:50.592777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:50.593684 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:50.594310 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:50.595635 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:50.919120 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9dc422a7-b9da-4abc-940b-4f04d40bc434 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:50.934550 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9dc422a7-b9da-4abc-940b-4f04d40bc434 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.623339 Sep 09 21:28:50.935666 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 199/388] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:50 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:50.943640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-52a3e17d-6062-4974-8859-c4cbf2c0576f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:50.949228 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-52a3e17d-6062-4974-8859-c4cbf2c0576f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:50.978839 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a3e17d-6062-4974-8859-c4cbf2c0576f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:50.979667 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a3e17d-6062-4974-8859-c4cbf2c0576f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:50.983067 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a3e17d-6062-4974-8859-c4cbf2c0576f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:50.983067 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a3e17d-6062-4974-8859-c4cbf2c0576f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:50.987908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a3e17d-6062-4974-8859-c4cbf2c0576f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:50.988513 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-52a3e17d-6062-4974-8859-c4cbf2c0576f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:51.266738 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:51.279368 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:51.286000 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-52a3e17d-6062-4974-8859-c4cbf2c0576f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:51.290169 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:51.291661 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-657b9b85-1fec-40a0-971e-bb1c2a55e73f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.738327 Sep 09 21:28:51.298457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-52a3e17d-6062-4974-8859-c4cbf2c0576f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1710 microversion: 2.1 time: 0.360328 Sep 09 21:28:51.311569 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 200/389] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:50 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1710 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:51.311829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 190/390] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:50 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:51.568903 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-80842a49-7a3e-4c3a-8f48-dc9ca2788f71 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:51.569517 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-80842a49-7a3e-4c3a-8f48-dc9ca2788f71 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:51.582138 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80842a49-7a3e-4c3a-8f48-dc9ca2788f71 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:51.582996 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80842a49-7a3e-4c3a-8f48-dc9ca2788f71 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:51.583711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80842a49-7a3e-4c3a-8f48-dc9ca2788f71 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:51.584719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80842a49-7a3e-4c3a-8f48-dc9ca2788f71 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:51.588675 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80842a49-7a3e-4c3a-8f48-dc9ca2788f71 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:51.589324 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80842a49-7a3e-4c3a-8f48-dc9ca2788f71 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:51.863074 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-80842a49-7a3e-4c3a-8f48-dc9ca2788f71 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:51.872103 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-80842a49-7a3e-4c3a-8f48-dc9ca2788f71 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.307557 Sep 09 21:28:51.872563 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 201/391] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:51 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:51.958790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a1a83a01-957c-4020-a896-42e97dd80bb1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:51.959396 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a1a83a01-957c-4020-a896-42e97dd80bb1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:51.968801 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1a83a01-957c-4020-a896-42e97dd80bb1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:51.970194 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1a83a01-957c-4020-a896-42e97dd80bb1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:51.970809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1a83a01-957c-4020-a896-42e97dd80bb1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:51.971807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1a83a01-957c-4020-a896-42e97dd80bb1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:51.972507 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1a83a01-957c-4020-a896-42e97dd80bb1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:51.973154 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1a83a01-957c-4020-a896-42e97dd80bb1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:52.256029 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a1a83a01-957c-4020-a896-42e97dd80bb1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:52.267670 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a1a83a01-957c-4020-a896-42e97dd80bb1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.313370 Sep 09 21:28:52.268618 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 191/392] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:51 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:52.326671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-80e98652-5715-48b1-a12f-fc4528542bb0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:52.328226 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-80e98652-5715-48b1-a12f-fc4528542bb0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:52.334692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:52.335614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:52.338360 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80e98652-5715-48b1-a12f-fc4528542bb0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:52.343737 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:52.344110 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:52.345244 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:52.345675 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80e98652-5715-48b1-a12f-fc4528542bb0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:52.345987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:52.346442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:52.346998 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:52.347281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80e98652-5715-48b1-a12f-fc4528542bb0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:52.348683 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80e98652-5715-48b1-a12f-fc4528542bb0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:52.349373 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80e98652-5715-48b1-a12f-fc4528542bb0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:52.350188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-80e98652-5715-48b1-a12f-fc4528542bb0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:52.575659 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-80e98652-5715-48b1-a12f-fc4528542bb0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:52.586900 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-80e98652-5715-48b1-a12f-fc4528542bb0 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1710 microversion: 2.1 time: 0.263685 Sep 09 21:28:52.587998 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 202/393] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:52 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1710 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:52.595253 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-5e73e06f-70ea-45e4-a2f6-aeab72070eff req-b7845d0d-4573-43b2-804f-60cca87f8a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb55d12-05c7-46ea-90fd-7bd4228c5aca", "tag": "0c869823-66ef-478f-abda-022d6694e58a"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:52.606681 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-5e73e06f-70ea-45e4-a2f6-aeab72070eff req-b7845d0d-4573-43b2-804f-60cca87f8a30 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:52.607402 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-5e73e06f-70ea-45e4-a2f6-aeab72070eff req-b7845d0d-4573-43b2-804f-60cca87f8a30 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:52.608074 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-5e73e06f-70ea-45e4-a2f6-aeab72070eff req-b7845d0d-4573-43b2-804f-60cca87f8a30 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:52.612152 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:52.624612 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:52.627198 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-5e73e06f-70ea-45e4-a2f6-aeab72070eff req-b7845d0d-4573-43b2-804f-60cca87f8a30 service nova] Creating event network-changed:0c869823-66ef-478f-abda-022d6694e58a for instance cfb55d12-05c7-46ea-90fd-7bd4228c5aca on hv-cinder-85221 Sep 09 21:28:52.630317 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:52.633907 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4b76ea03-ee22-41ef-8a6c-3b7c343c76c8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.303083 Sep 09 21:28:52.638803 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-5e73e06f-70ea-45e4-a2f6-aeab72070eff req-b7845d0d-4573-43b2-804f-60cca87f8a30 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049267 Sep 09 21:28:52.647910 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 203/394] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:28:52.655058 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 192/395] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:52 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:52.899478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-aede694a-ecd6-4a3e-b491-9cf3cebdce81 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:52.900213 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-aede694a-ecd6-4a3e-b491-9cf3cebdce81 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:52.912704 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aede694a-ecd6-4a3e-b491-9cf3cebdce81 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:52.913201 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aede694a-ecd6-4a3e-b491-9cf3cebdce81 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:52.913637 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aede694a-ecd6-4a3e-b491-9cf3cebdce81 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:52.914342 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aede694a-ecd6-4a3e-b491-9cf3cebdce81 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:52.914955 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aede694a-ecd6-4a3e-b491-9cf3cebdce81 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:52.915237 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aede694a-ecd6-4a3e-b491-9cf3cebdce81 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:53.207656 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-aede694a-ecd6-4a3e-b491-9cf3cebdce81 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:53.217550 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-aede694a-ecd6-4a3e-b491-9cf3cebdce81 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.324757 Sep 09 21:28:53.218268 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 204/396] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:52 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:53.293593 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-81ad6162-7a92-4858-a37c-c66efd8030a0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:53.294998 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-81ad6162-7a92-4858-a37c-c66efd8030a0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:53.304344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81ad6162-7a92-4858-a37c-c66efd8030a0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:53.305324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81ad6162-7a92-4858-a37c-c66efd8030a0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:53.306323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81ad6162-7a92-4858-a37c-c66efd8030a0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:53.307375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81ad6162-7a92-4858-a37c-c66efd8030a0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:53.308094 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81ad6162-7a92-4858-a37c-c66efd8030a0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:53.308734 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-81ad6162-7a92-4858-a37c-c66efd8030a0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:53.456238 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-81ad6162-7a92-4858-a37c-c66efd8030a0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:53.465509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-81ad6162-7a92-4858-a37c-c66efd8030a0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.176926 Sep 09 21:28:53.466188 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 193/397] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:53 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:53.614253 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bdda5637-788c-4268-af22-957e606405ed tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:53.615441 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bdda5637-788c-4268-af22-957e606405ed tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:53.622250 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdda5637-788c-4268-af22-957e606405ed tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:53.622606 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdda5637-788c-4268-af22-957e606405ed tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:53.623081 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdda5637-788c-4268-af22-957e606405ed tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:53.623799 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdda5637-788c-4268-af22-957e606405ed tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:53.624537 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdda5637-788c-4268-af22-957e606405ed tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:53.625124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bdda5637-788c-4268-af22-957e606405ed tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:53.663374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:53.664570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:53.671730 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:53.673925 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:53.674557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:53.675372 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:53.675953 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:53.676686 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:53.795599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bdda5637-788c-4268-af22-957e606405ed tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:53.806764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bdda5637-788c-4268-af22-957e606405ed tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1714 microversion: 2.1 time: 0.197112 Sep 09 21:28:53.820625 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 205/398] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:53 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1714 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:53.854456 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:53.865224 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:53.866853 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:53.868474 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1b1d53aa-16be-47fb-b0ba-2b20ec9c6416 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.210659 Sep 09 21:28:53.869405 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 194/399] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:53 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:28:54.242731 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3b876454-18d0-41dc-a8b2-96f3ade99ab8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:54.243867 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3b876454-18d0-41dc-a8b2-96f3ade99ab8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:54.252644 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b876454-18d0-41dc-a8b2-96f3ade99ab8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:54.253474 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b876454-18d0-41dc-a8b2-96f3ade99ab8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:54.254131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b876454-18d0-41dc-a8b2-96f3ade99ab8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:54.255053 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b876454-18d0-41dc-a8b2-96f3ade99ab8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:54.255608 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b876454-18d0-41dc-a8b2-96f3ade99ab8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:54.256229 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b876454-18d0-41dc-a8b2-96f3ade99ab8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:54.423330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3b876454-18d0-41dc-a8b2-96f3ade99ab8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:54.432710 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3b876454-18d0-41dc-a8b2-96f3ade99ab8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.195271 Sep 09 21:28:54.435583 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 206/400] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:54 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:28:54.489585 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8d9f8440-e8cb-4474-94c4-50fa6acb88f0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:54.490247 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8d9f8440-e8cb-4474-94c4-50fa6acb88f0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:54.495748 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=4 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:54.496964 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=22 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:54.501574 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8d9f8440-e8cb-4474-94c4-50fa6acb88f0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:54.502444 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8d9f8440-e8cb-4474-94c4-50fa6acb88f0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:54.503026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8d9f8440-e8cb-4474-94c4-50fa6acb88f0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:54.504229 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8d9f8440-e8cb-4474-94c4-50fa6acb88f0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:54.505184 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8d9f8440-e8cb-4474-94c4-50fa6acb88f0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:54.505776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8d9f8440-e8cb-4474-94c4-50fa6acb88f0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:54.668748 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8d9f8440-e8cb-4474-94c4-50fa6acb88f0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:54.678337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8d9f8440-e8cb-4474-94c4-50fa6acb88f0 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.193019 Sep 09 21:28:54.679351 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 195/401] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:54 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:54.898942 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:54.900401 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:54.902425 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:54.912302 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:54.912787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:54.916820 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:54.917886 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:54.918540 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:54.919214 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:54.927312 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=100 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:55.090807 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:55.100839 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:55.102507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:55.103569 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-dfc0ade6-1296-4675-8168-daf316c434b8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.209290 Sep 09 21:28:55.109001 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 207/402] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:54 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:55.456957 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f553c885-df35-41f0-9b7c-6c280fd1aca6 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:55.457763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f553c885-df35-41f0-9b7c-6c280fd1aca6 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:55.465266 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f553c885-df35-41f0-9b7c-6c280fd1aca6 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:55.465781 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f553c885-df35-41f0-9b7c-6c280fd1aca6 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:55.466539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f553c885-df35-41f0-9b7c-6c280fd1aca6 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:55.467450 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f553c885-df35-41f0-9b7c-6c280fd1aca6 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:55.468032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f553c885-df35-41f0-9b7c-6c280fd1aca6 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:55.468578 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f553c885-df35-41f0-9b7c-6c280fd1aca6 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:55.620718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f553c885-df35-41f0-9b7c-6c280fd1aca6 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:55.631384 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f553c885-df35-41f0-9b7c-6c280fd1aca6 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.178828 Sep 09 21:28:55.635374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 196/403] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:55 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:55.702276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-855bc3be-bc5e-4f40-b4f5-e42965ca563d tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:55.703227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-855bc3be-bc5e-4f40-b4f5-e42965ca563d tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:55.710866 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-855bc3be-bc5e-4f40-b4f5-e42965ca563d tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:55.711364 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-855bc3be-bc5e-4f40-b4f5-e42965ca563d tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:55.711836 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-855bc3be-bc5e-4f40-b4f5-e42965ca563d tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:55.712643 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-855bc3be-bc5e-4f40-b4f5-e42965ca563d tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:55.713281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-855bc3be-bc5e-4f40-b4f5-e42965ca563d tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:55.713710 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-855bc3be-bc5e-4f40-b4f5-e42965ca563d tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:55.884937 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-855bc3be-bc5e-4f40-b4f5-e42965ca563d tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:55.899679 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-855bc3be-bc5e-4f40-b4f5-e42965ca563d tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.201247 Sep 09 21:28:55.900583 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 208/404] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:55 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:56.130726 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:56.131468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:56.137684 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:56.138116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:56.138634 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:56.139329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:56.139829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:56.140260 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:56.280005 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:56.288325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:56.289758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:56.290922 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f0b46c02-40f7-4703-bde0-d27ee28707cc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.164222 Sep 09 21:28:56.294429 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 197/405] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:56 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:56.658558 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bce841a8-5a3e-48e3-8975-2e47f5049ab0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:56.659473 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bce841a8-5a3e-48e3-8975-2e47f5049ab0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:56.666763 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bce841a8-5a3e-48e3-8975-2e47f5049ab0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:56.667953 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bce841a8-5a3e-48e3-8975-2e47f5049ab0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:56.668908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bce841a8-5a3e-48e3-8975-2e47f5049ab0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:56.670676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bce841a8-5a3e-48e3-8975-2e47f5049ab0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:56.671194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bce841a8-5a3e-48e3-8975-2e47f5049ab0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:56.671990 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bce841a8-5a3e-48e3-8975-2e47f5049ab0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:56.807056 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bce841a8-5a3e-48e3-8975-2e47f5049ab0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:56.815579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bce841a8-5a3e-48e3-8975-2e47f5049ab0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.161392 Sep 09 21:28:56.816142 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 209/406] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:56 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:56.923617 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8cb303f0-5aa7-40ad-83ff-2c2aa80cbf72 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:56.924299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8cb303f0-5aa7-40ad-83ff-2c2aa80cbf72 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:56.931312 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8cb303f0-5aa7-40ad-83ff-2c2aa80cbf72 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:56.932596 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8cb303f0-5aa7-40ad-83ff-2c2aa80cbf72 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:56.933048 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8cb303f0-5aa7-40ad-83ff-2c2aa80cbf72 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:56.933754 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8cb303f0-5aa7-40ad-83ff-2c2aa80cbf72 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:56.934339 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8cb303f0-5aa7-40ad-83ff-2c2aa80cbf72 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:56.934796 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8cb303f0-5aa7-40ad-83ff-2c2aa80cbf72 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:57.124071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8cb303f0-5aa7-40ad-83ff-2c2aa80cbf72 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:57.132479 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8cb303f0-5aa7-40ad-83ff-2c2aa80cbf72 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.213240 Sep 09 21:28:57.133060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 198/407] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:56 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:57.316949 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:57.318162 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:57.324454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:57.325173 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:57.325846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:57.326781 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:57.327579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:57.328171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:57.472580 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:57.481901 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:57.483479 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:57.484713 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-20886b53-eb04-4975-922d-7f19a3dd7a91 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1741 microversion: 2.20 time: 0.172379 Sep 09 21:28:57.485901 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 210/408] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:57 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:28:57.838378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-84994513-f35a-4635-a4ac-9f0413c51039 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:57.838910 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-84994513-f35a-4635-a4ac-9f0413c51039 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:57.845762 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84994513-f35a-4635-a4ac-9f0413c51039 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:57.846258 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84994513-f35a-4635-a4ac-9f0413c51039 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:57.846696 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84994513-f35a-4635-a4ac-9f0413c51039 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:57.847394 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84994513-f35a-4635-a4ac-9f0413c51039 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:57.847880 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84994513-f35a-4635-a4ac-9f0413c51039 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:57.848304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84994513-f35a-4635-a4ac-9f0413c51039 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:57.852723 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:28:58.074989 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-84994513-f35a-4635-a4ac-9f0413c51039 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:58.083609 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-84994513-f35a-4635-a4ac-9f0413c51039 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.249113 Sep 09 21:28:58.084191 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 199/409] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:57 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:58.155288 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-aad4592d-1bdb-49a3-9955-cb64e338b8a1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:58.155936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-aad4592d-1bdb-49a3-9955-cb64e338b8a1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:58.162538 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aad4592d-1bdb-49a3-9955-cb64e338b8a1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:58.163025 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aad4592d-1bdb-49a3-9955-cb64e338b8a1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:58.163486 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aad4592d-1bdb-49a3-9955-cb64e338b8a1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:58.164184 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aad4592d-1bdb-49a3-9955-cb64e338b8a1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:58.164639 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aad4592d-1bdb-49a3-9955-cb64e338b8a1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:58.165067 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aad4592d-1bdb-49a3-9955-cb64e338b8a1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:58.298080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-aad4592d-1bdb-49a3-9955-cb64e338b8a1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:58.305759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-aad4592d-1bdb-49a3-9955-cb64e338b8a1 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.154251 Sep 09 21:28:58.306422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 211/410] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:58 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:58.512595 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:58.513210 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:58.519329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:58.519860 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:58.520310 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:58.521009 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:58.521470 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:58.521902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:58.655564 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:58.664033 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:58.665497 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:58.666651 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-562f10be-98de-46fa-bf4d-fe641f19ab9d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1723 microversion: 2.20 time: 0.157960 Sep 09 21:28:58.667204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 200/411] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:58 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:28:58.999653 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-a616db12-6e50-4d1f-9b67-7147fc32423e req-2be2ffaa-5450-4daa-87ba-5c8a3e1bb5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0a8dd3-202a-407d-ae71-aab47f86d6f5", "name": "network-vif-plugged", "status": "completed", "tag": "7a98c16e-6360-4bb7-9f82-5a8d9091e05f"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:28:59.010940 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-a616db12-6e50-4d1f-9b67-7147fc32423e req-2be2ffaa-5450-4daa-87ba-5c8a3e1bb5d3 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:59.011676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-a616db12-6e50-4d1f-9b67-7147fc32423e req-2be2ffaa-5450-4daa-87ba-5c8a3e1bb5d3 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:59.012107 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-a616db12-6e50-4d1f-9b67-7147fc32423e req-2be2ffaa-5450-4daa-87ba-5c8a3e1bb5d3 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:59.023897 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-a616db12-6e50-4d1f-9b67-7147fc32423e req-2be2ffaa-5450-4daa-87ba-5c8a3e1bb5d3 service nova] Creating event network-vif-plugged:7a98c16e-6360-4bb7-9f82-5a8d9091e05f for instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 on hv-cinder-85221 Sep 09 21:28:59.029108 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-a616db12-6e50-4d1f-9b67-7147fc32423e req-2be2ffaa-5450-4daa-87ba-5c8a3e1bb5d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033171 Sep 09 21:28:59.029851 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 212/412] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:28:59.105490 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0ffeb5ae-ada3-427f-b2d4-095f652c9898 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:59.106153 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0ffeb5ae-ada3-427f-b2d4-095f652c9898 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:59.113395 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0ffeb5ae-ada3-427f-b2d4-095f652c9898 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:59.113891 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0ffeb5ae-ada3-427f-b2d4-095f652c9898 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:59.114354 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0ffeb5ae-ada3-427f-b2d4-095f652c9898 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:59.115098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0ffeb5ae-ada3-427f-b2d4-095f652c9898 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:59.115560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0ffeb5ae-ada3-427f-b2d4-095f652c9898 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:59.115979 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0ffeb5ae-ada3-427f-b2d4-095f652c9898 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:59.279758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0ffeb5ae-ada3-427f-b2d4-095f652c9898 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:59.288776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0ffeb5ae-ada3-427f-b2d4-095f652c9898 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.187103 Sep 09 21:28:59.289348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 201/413] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:59 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:59.330308 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b43dcc5e-3092-4ffd-b972-6661097a404f tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:59.331028 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b43dcc5e-3092-4ffd-b972-6661097a404f tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:59.336988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b43dcc5e-3092-4ffd-b972-6661097a404f tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:59.337465 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b43dcc5e-3092-4ffd-b972-6661097a404f tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:59.337900 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b43dcc5e-3092-4ffd-b972-6661097a404f tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:59.338601 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b43dcc5e-3092-4ffd-b972-6661097a404f tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:59.339056 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b43dcc5e-3092-4ffd-b972-6661097a404f tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:59.339474 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b43dcc5e-3092-4ffd-b972-6661097a404f tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:59.468784 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b43dcc5e-3092-4ffd-b972-6661097a404f tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:59.476971 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b43dcc5e-3092-4ffd-b972-6661097a404f tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.151976 Sep 09 21:28:59.477528 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 213/414] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:28:59 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:28:59.693084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:28:59.693630 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:28:59.699515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:59.700018 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:59.700477 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:59.701147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:28:59.701597 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:28:59.702011 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:28:59.834634 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:59.842536 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:59.844002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:28:59.845151 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b9269cfb-911c-46d7-aa68-c0e6f7fd3a84 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1723 microversion: 2.20 time: 0.156196 Sep 09 21:28:59.845694 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 202/415] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:28:59 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:00.311509 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4c9ca7df-ee97-40a4-9666-7fc5acd4c4a0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:00.312140 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4c9ca7df-ee97-40a4-9666-7fc5acd4c4a0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:00.318640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c9ca7df-ee97-40a4-9666-7fc5acd4c4a0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:00.319126 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c9ca7df-ee97-40a4-9666-7fc5acd4c4a0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:00.319580 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c9ca7df-ee97-40a4-9666-7fc5acd4c4a0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:00.320255 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c9ca7df-ee97-40a4-9666-7fc5acd4c4a0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:00.320702 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c9ca7df-ee97-40a4-9666-7fc5acd4c4a0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:00.321121 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c9ca7df-ee97-40a4-9666-7fc5acd4c4a0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:00.451206 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4c9ca7df-ee97-40a4-9666-7fc5acd4c4a0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:00.459387 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4c9ca7df-ee97-40a4-9666-7fc5acd4c4a0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.151734 Sep 09 21:29:00.459965 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 214/416] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:00 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:00.499092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a6dcfea1-7614-4730-ac95-be022dccef1e tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:00.499728 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a6dcfea1-7614-4730-ac95-be022dccef1e tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:00.506529 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a6dcfea1-7614-4730-ac95-be022dccef1e tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:00.507010 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a6dcfea1-7614-4730-ac95-be022dccef1e tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:00.507441 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a6dcfea1-7614-4730-ac95-be022dccef1e tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:00.508150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a6dcfea1-7614-4730-ac95-be022dccef1e tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:00.508601 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a6dcfea1-7614-4730-ac95-be022dccef1e tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:00.509023 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a6dcfea1-7614-4730-ac95-be022dccef1e tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:00.636779 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a6dcfea1-7614-4730-ac95-be022dccef1e tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:00.645136 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a6dcfea1-7614-4730-ac95-be022dccef1e tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.149762 Sep 09 21:29:00.645702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 203/417] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:00 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:00.871185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:00.871977 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:00.878781 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:00.879269 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:00.879736 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:00.880428 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:00.880884 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:00.881305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:01.031559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:01.041212 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:01.042824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:01.044105 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-87bd8be6-6a6c-4cae-8aba-b4164591c410 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1723 microversion: 2.20 time: 0.177542 Sep 09 21:29:01.045302 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 215/418] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:00 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:01.481768 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6b3fec26-e932-4941-a9bc-fbfb27661a14 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:01.482465 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6b3fec26-e932-4941-a9bc-fbfb27661a14 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:01.489898 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b3fec26-e932-4941-a9bc-fbfb27661a14 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:01.490392 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b3fec26-e932-4941-a9bc-fbfb27661a14 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:01.490859 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b3fec26-e932-4941-a9bc-fbfb27661a14 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:01.491559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b3fec26-e932-4941-a9bc-fbfb27661a14 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:01.492015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b3fec26-e932-4941-a9bc-fbfb27661a14 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:01.492466 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b3fec26-e932-4941-a9bc-fbfb27661a14 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:01.627551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6b3fec26-e932-4941-a9bc-fbfb27661a14 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:01.635155 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6b3fec26-e932-4941-a9bc-fbfb27661a14 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.157222 Sep 09 21:29:01.635766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 204/419] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:01 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:01.667086 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0e7a75e3-088b-4623-a3a2-2e8bd47b66b2 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:01.667753 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0e7a75e3-088b-4623-a3a2-2e8bd47b66b2 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:01.674507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0e7a75e3-088b-4623-a3a2-2e8bd47b66b2 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:01.674991 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0e7a75e3-088b-4623-a3a2-2e8bd47b66b2 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:01.675428 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0e7a75e3-088b-4623-a3a2-2e8bd47b66b2 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:01.676148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0e7a75e3-088b-4623-a3a2-2e8bd47b66b2 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:01.676609 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0e7a75e3-088b-4623-a3a2-2e8bd47b66b2 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:01.677036 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0e7a75e3-088b-4623-a3a2-2e8bd47b66b2 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:01.810183 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0e7a75e3-088b-4623-a3a2-2e8bd47b66b2 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:01.818603 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0e7a75e3-088b-4623-a3a2-2e8bd47b66b2 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.155370 Sep 09 21:29:01.819426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 216/420] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:01 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:02.070592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:02.071137 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:02.077166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:02.077654 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:02.078094 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:02.078779 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:02.079242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:02.079740 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:02.209914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:02.217905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:02.219331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:02.221170 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4b14ed9a-4267-4cf7-a489-acb75f738647 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1723 microversion: 2.20 time: 0.154012 Sep 09 21:29:02.221736 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 205/421] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:02 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:02.658307 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-190aedcb-fdd3-4136-a64a-654704d318ce tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:02.659160 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-190aedcb-fdd3-4136-a64a-654704d318ce tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:02.665069 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-190aedcb-fdd3-4136-a64a-654704d318ce tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:02.665543 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-190aedcb-fdd3-4136-a64a-654704d318ce tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:02.665977 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-190aedcb-fdd3-4136-a64a-654704d318ce tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:02.666649 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-190aedcb-fdd3-4136-a64a-654704d318ce tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:02.667100 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-190aedcb-fdd3-4136-a64a-654704d318ce tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:02.667680 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-190aedcb-fdd3-4136-a64a-654704d318ce tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:02.806261 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-190aedcb-fdd3-4136-a64a-654704d318ce tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:02.814515 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-190aedcb-fdd3-4136-a64a-654704d318ce tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1257 microversion: 2.1 time: 0.159548 Sep 09 21:29:02.815096 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 217/422] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:02 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:02.841954 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-96eee754-39a2-4a86-9d99-fa4761a1db64 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:02.842570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-96eee754-39a2-4a86-9d99-fa4761a1db64 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:02.849341 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96eee754-39a2-4a86-9d99-fa4761a1db64 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:02.849818 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96eee754-39a2-4a86-9d99-fa4761a1db64 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:02.850250 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96eee754-39a2-4a86-9d99-fa4761a1db64 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:02.850929 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96eee754-39a2-4a86-9d99-fa4761a1db64 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:02.851381 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96eee754-39a2-4a86-9d99-fa4761a1db64 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:02.851899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-96eee754-39a2-4a86-9d99-fa4761a1db64 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:02.985635 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-96eee754-39a2-4a86-9d99-fa4761a1db64 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:02.994390 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-96eee754-39a2-4a86-9d99-fa4761a1db64 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.156175 Sep 09 21:29:02.995474 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 206/423] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:02 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:03.202116 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-8dcab252-a2c4-485f-932c-af293ff6783b req-f61c60d3-6fb8-455f-a289-8d7cf1642353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb55d12-05c7-46ea-90fd-7bd4228c5aca", "name": "network-vif-plugged", "status": "completed", "tag": "0c869823-66ef-478f-abda-022d6694e58a"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:29:03.212494 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-8dcab252-a2c4-485f-932c-af293ff6783b req-f61c60d3-6fb8-455f-a289-8d7cf1642353 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:03.212980 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-8dcab252-a2c4-485f-932c-af293ff6783b req-f61c60d3-6fb8-455f-a289-8d7cf1642353 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:03.213415 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-8dcab252-a2c4-485f-932c-af293ff6783b req-f61c60d3-6fb8-455f-a289-8d7cf1642353 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:03.227090 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-8dcab252-a2c4-485f-932c-af293ff6783b req-f61c60d3-6fb8-455f-a289-8d7cf1642353 service nova] Creating event network-vif-plugged:0c869823-66ef-478f-abda-022d6694e58a for instance cfb55d12-05c7-46ea-90fd-7bd4228c5aca on hv-cinder-85221 Sep 09 21:29:03.231820 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-8dcab252-a2c4-485f-932c-af293ff6783b req-f61c60d3-6fb8-455f-a289-8d7cf1642353 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033376 Sep 09 21:29:03.232599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 218/424] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:29:03.246548 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:03.247249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:03.253916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:03.254406 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:03.254928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:03.255708 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:03.256174 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:03.256606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:03.388920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:03.397662 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:03.399211 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:03.400399 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e4eafdb4-063d-45c0-bfdd-1ae11bfa8cb6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1666 microversion: 2.20 time: 0.157942 Sep 09 21:29:03.400951 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 207/425] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:03 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:03.426353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f2b4cf75-90ad-4dd7-af3f-3a969240a614 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0816021-bc56-44cc-aafc-4a35db853293"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:29:03.428835 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f2b4cf75-90ad-4dd7-af3f-3a969240a614 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:03.434815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f2b4cf75-90ad-4dd7-af3f-3a969240a614 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:03.435295 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f2b4cf75-90ad-4dd7-af3f-3a969240a614 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:03.435784 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f2b4cf75-90ad-4dd7-af3f-3a969240a614 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:03.436443 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f2b4cf75-90ad-4dd7-af3f-3a969240a614 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:03.436893 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f2b4cf75-90ad-4dd7-af3f-3a969240a614 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:03.437315 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f2b4cf75-90ad-4dd7-af3f-3a969240a614 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:03.718911 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f2b4cf75-90ad-4dd7-af3f-3a969240a614 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "POST /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297351 Sep 09 21:29:03.719654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 219/426] 10.222.0.46 () {62 vars in 1364 bytes} [Fri Sep 9 21:29:03 2022] POST /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:29:03.836712 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-747a664b-4479-4f96-b553-a522aa39f8ee tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:03.837729 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-747a664b-4479-4f96-b553-a522aa39f8ee tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:03.843668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-747a664b-4479-4f96-b553-a522aa39f8ee tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:03.844788 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-747a664b-4479-4f96-b553-a522aa39f8ee tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:03.845267 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-747a664b-4479-4f96-b553-a522aa39f8ee tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:03.845973 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-747a664b-4479-4f96-b553-a522aa39f8ee tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:03.846438 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-747a664b-4479-4f96-b553-a522aa39f8ee tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:03.846865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-747a664b-4479-4f96-b553-a522aa39f8ee tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:03.860031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3a5fcb57-c55f-4e3a-9146-41edabfb802b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:29:03.861498 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3a5fcb57-c55f-4e3a-9146-41edabfb802b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:03.868436 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3a5fcb57-c55f-4e3a-9146-41edabfb802b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:03.869032 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3a5fcb57-c55f-4e3a-9146-41edabfb802b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:03.869566 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3a5fcb57-c55f-4e3a-9146-41edabfb802b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:03.870361 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3a5fcb57-c55f-4e3a-9146-41edabfb802b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:03.871029 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3a5fcb57-c55f-4e3a-9146-41edabfb802b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:03.871682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3a5fcb57-c55f-4e3a-9146-41edabfb802b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:03.920183 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3a5fcb57-c55f-4e3a-9146-41edabfb802b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120465) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 21:29:03.988560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3a5fcb57-c55f-4e3a-9146-41edabfb802b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "POST /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/action" status: 202 len: 0 microversion: 2.20 time: 0.132358 Sep 09 21:29:03.989508 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 220/427] 10.222.0.46 () {62 vars in 1319 bytes} [Fri Sep 9 21:29:03 2022] POST /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 21:29:03.997300 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:03.998171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:04.004877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:04.005376 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:04.005820 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:04.006527 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:04.007320 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:04.007447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:04.021355 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-747a664b-4479-4f96-b553-a522aa39f8ee tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:04.029619 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-747a664b-4479-4f96-b553-a522aa39f8ee tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1441 microversion: 2.1 time: 0.196659 Sep 09 21:29:04.030437 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 208/428] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:03 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1441 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:04.035709 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5046a7ea-2859-4ec7-96fb-9ed1d83d91c4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:04.036322 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5046a7ea-2859-4ec7-96fb-9ed1d83d91c4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:04.040495 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:04.042331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5046a7ea-2859-4ec7-96fb-9ed1d83d91c4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:04.043009 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5046a7ea-2859-4ec7-96fb-9ed1d83d91c4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:04.043651 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5046a7ea-2859-4ec7-96fb-9ed1d83d91c4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:04.044710 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5046a7ea-2859-4ec7-96fb-9ed1d83d91c4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:04.045325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5046a7ea-2859-4ec7-96fb-9ed1d83d91c4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:04.045916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5046a7ea-2859-4ec7-96fb-9ed1d83d91c4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:04.183829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:04.194049 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:04.195772 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5046a7ea-2859-4ec7-96fb-9ed1d83d91c4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:04.196789 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:04.198462 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9f50c0af-b597-4ec8-b5e9-e26e85a21867 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1752 microversion: 2.20 time: 0.205008 Sep 09 21:29:04.207574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 221/429] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:03 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:29:04.207574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d6042628-ea79-47fd-8d9e-21b04e7ace0a tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:04.207574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d6042628-ea79-47fd-8d9e-21b04e7ace0a tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:04.212600 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5046a7ea-2859-4ec7-96fb-9ed1d83d91c4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.179746 Sep 09 21:29:04.212776 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6042628-ea79-47fd-8d9e-21b04e7ace0a tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:04.213094 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6042628-ea79-47fd-8d9e-21b04e7ace0a tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:04.213536 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6042628-ea79-47fd-8d9e-21b04e7ace0a tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:04.214225 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6042628-ea79-47fd-8d9e-21b04e7ace0a tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:04.214850 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6042628-ea79-47fd-8d9e-21b04e7ace0a tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:04.215307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 209/430] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:04 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:04.215867 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d6042628-ea79-47fd-8d9e-21b04e7ace0a tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:04.354044 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d6042628-ea79-47fd-8d9e-21b04e7ace0a tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:04.362236 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d6042628-ea79-47fd-8d9e-21b04e7ace0a tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1441 microversion: 2.1 time: 0.159863 Sep 09 21:29:04.362882 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 222/431] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:04 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1441 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:05.223759 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:05.225205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:05.233930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:05.235673 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:05.235673 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:05.237080 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:05.237876 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:05.238509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:05.240067 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-889c171d-34d0-4ac6-acb9-76536efc0d21 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:05.241302 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-889c171d-34d0-4ac6-acb9-76536efc0d21 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:05.248818 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-889c171d-34d0-4ac6-acb9-76536efc0d21 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:05.249654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-889c171d-34d0-4ac6-acb9-76536efc0d21 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:05.250314 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-889c171d-34d0-4ac6-acb9-76536efc0d21 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:05.252615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-889c171d-34d0-4ac6-acb9-76536efc0d21 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:05.253421 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-889c171d-34d0-4ac6-acb9-76536efc0d21 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:05.254222 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-889c171d-34d0-4ac6-acb9-76536efc0d21 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:05.401051 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:05.411072 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:05.413811 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:05.414258 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f2886795-8f08-4fcb-8625-748902ed2a50 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1752 microversion: 2.20 time: 0.195112 Sep 09 21:29:05.415116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 210/432] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:05 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1752 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:05.419568 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-e88610a7-4dd4-440c-82b9-64a9d651b1e0 req-74d2518d-2d02-43ba-9767-cb6a4d84bd32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8f74a7-256c-4810-944b-e4f66773aa13", "name": "network-vif-unplugged", "status": "completed", "tag": "b28ee03c-d6a8-454c-b9c8-a9a10b589dbc"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:29:05.430411 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-e88610a7-4dd4-440c-82b9-64a9d651b1e0 req-74d2518d-2d02-43ba-9767-cb6a4d84bd32 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:05.431433 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-e88610a7-4dd4-440c-82b9-64a9d651b1e0 req-74d2518d-2d02-43ba-9767-cb6a4d84bd32 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:05.432310 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-e88610a7-4dd4-440c-82b9-64a9d651b1e0 req-74d2518d-2d02-43ba-9767-cb6a4d84bd32 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:05.445899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.compute.server_external_events [req-e88610a7-4dd4-440c-82b9-64a9d651b1e0 req-74d2518d-2d02-43ba-9767-cb6a4d84bd32 service nova] Unable to find a host for instance cb8f74a7-256c-4810-944b-e4f66773aa13. Dropping event network-vif-unplugged {{(pid=120466) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 21:29:05.446804 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-e88610a7-4dd4-440c-82b9-64a9d651b1e0 req-74d2518d-2d02-43ba-9767-cb6a4d84bd32 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030887 Sep 09 21:29:05.447436 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 211/433] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 21:29:05.746337 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-889c171d-34d0-4ac6-acb9-76536efc0d21 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:05.754610 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-889c171d-34d0-4ac6-acb9-76536efc0d21 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1315 microversion: 2.1 time: 0.521616 Sep 09 21:29:05.755546 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 223/434] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:05 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:06.441751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:06.442297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:06.449763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:06.450496 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:06.450938 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:06.451664 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:06.452283 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:06.452862 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:06.490183 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-62dc316c-c3d9-46b1-a9dc-e0d9b3ea0de4 req-6666bfd2-a9fa-4b8d-910c-3097f1a5997e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c0a8dd3-202a-407d-ae71-aab47f86d6f5", "tag": "7a98c16e-6360-4bb7-9f82-5a8d9091e05f"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:29:06.502832 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-62dc316c-c3d9-46b1-a9dc-e0d9b3ea0de4 req-6666bfd2-a9fa-4b8d-910c-3097f1a5997e service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:06.503745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-62dc316c-c3d9-46b1-a9dc-e0d9b3ea0de4 req-6666bfd2-a9fa-4b8d-910c-3097f1a5997e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:06.504380 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-62dc316c-c3d9-46b1-a9dc-e0d9b3ea0de4 req-6666bfd2-a9fa-4b8d-910c-3097f1a5997e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:06.516033 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-62dc316c-c3d9-46b1-a9dc-e0d9b3ea0de4 req-6666bfd2-a9fa-4b8d-910c-3097f1a5997e service nova] Creating event network-changed:7a98c16e-6360-4bb7-9f82-5a8d9091e05f for instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 on hv-cinder-85221 Sep 09 21:29:06.522231 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-62dc316c-c3d9-46b1-a9dc-e0d9b3ea0de4 req-6666bfd2-a9fa-4b8d-910c-3097f1a5997e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037186 Sep 09 21:29:06.523300 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 224/435] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:29:06.598744 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:06.615884 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:06.617906 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:06.619368 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d26af426-45b9-46d7-9380-b0b3721f7196 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1754 microversion: 2.20 time: 0.181542 Sep 09 21:29:06.620220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 212/436] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:06 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:06.778667 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-da2672ff-f4df-4d6d-aa0c-02a2dc54e4b4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:06.779751 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-da2672ff-f4df-4d6d-aa0c-02a2dc54e4b4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:06.786593 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-da2672ff-f4df-4d6d-aa0c-02a2dc54e4b4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:06.787948 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-da2672ff-f4df-4d6d-aa0c-02a2dc54e4b4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:06.788378 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-da2672ff-f4df-4d6d-aa0c-02a2dc54e4b4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:06.789227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-da2672ff-f4df-4d6d-aa0c-02a2dc54e4b4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:06.790344 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-da2672ff-f4df-4d6d-aa0c-02a2dc54e4b4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:06.790599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-da2672ff-f4df-4d6d-aa0c-02a2dc54e4b4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:06.940073 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-da2672ff-f4df-4d6d-aa0c-02a2dc54e4b4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:06.951595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-da2672ff-f4df-4d6d-aa0c-02a2dc54e4b4 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1465 microversion: 2.1 time: 0.177106 Sep 09 21:29:06.953393 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 225/437] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:06 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1465 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:07.007080 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-53cf73c3-72ce-4bc9-b3ae-480cda55a6d3 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:07.007601 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-53cf73c3-72ce-4bc9-b3ae-480cda55a6d3 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:07.013926 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-53cf73c3-72ce-4bc9-b3ae-480cda55a6d3 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:07.014414 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-53cf73c3-72ce-4bc9-b3ae-480cda55a6d3 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:07.014850 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-53cf73c3-72ce-4bc9-b3ae-480cda55a6d3 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:07.015795 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-53cf73c3-72ce-4bc9-b3ae-480cda55a6d3 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:07.016430 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-53cf73c3-72ce-4bc9-b3ae-480cda55a6d3 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:07.017614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-53cf73c3-72ce-4bc9-b3ae-480cda55a6d3 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:07.048950 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-53cf73c3-72ce-4bc9-b3ae-480cda55a6d3 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:29:07.158625 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-53cf73c3-72ce-4bc9-b3ae-480cda55a6d3 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 204 len: 0 microversion: 2.1 time: 0.154308 Sep 09 21:29:07.160296 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 213/438] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:29:07 2022] DELETE /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:29:07.168353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-449e49f8-365c-4ffb-9ed5-4b9b07591262 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:07.170166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-449e49f8-365c-4ffb-9ed5-4b9b07591262 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:07.177639 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-449e49f8-365c-4ffb-9ed5-4b9b07591262 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:07.178126 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-449e49f8-365c-4ffb-9ed5-4b9b07591262 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:07.179284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-449e49f8-365c-4ffb-9ed5-4b9b07591262 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:07.180206 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-449e49f8-365c-4ffb-9ed5-4b9b07591262 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:07.180912 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-449e49f8-365c-4ffb-9ed5-4b9b07591262 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:07.181306 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-449e49f8-365c-4ffb-9ed5-4b9b07591262 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:07.321271 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-449e49f8-365c-4ffb-9ed5-4b9b07591262 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:07.329274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-449e49f8-365c-4ffb-9ed5-4b9b07591262 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1471 microversion: 2.1 time: 0.164702 Sep 09 21:29:07.330064 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 226/439] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:07 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:07.646410 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:07.647102 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:07.654687 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:07.655172 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:07.655633 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:07.656312 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:07.656766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:07.657185 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:07.788867 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:07.791092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:07.799144 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:07.800598 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:07.801738 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-41e82fc1-3a84-408a-91be-944aa0d23171 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1754 microversion: 2.20 time: 0.159744 Sep 09 21:29:07.802282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 214/440] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:07 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:08.352349 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e49ae3a2-1810-4760-a7d8-8e34d82295ea tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:08.352956 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e49ae3a2-1810-4760-a7d8-8e34d82295ea tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:08.359275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e49ae3a2-1810-4760-a7d8-8e34d82295ea tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:08.359785 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e49ae3a2-1810-4760-a7d8-8e34d82295ea tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:08.360246 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e49ae3a2-1810-4760-a7d8-8e34d82295ea tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:08.361488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e49ae3a2-1810-4760-a7d8-8e34d82295ea tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:08.361955 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e49ae3a2-1810-4760-a7d8-8e34d82295ea tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:08.362376 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e49ae3a2-1810-4760-a7d8-8e34d82295ea tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:08.492071 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e49ae3a2-1810-4760-a7d8-8e34d82295ea tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:08.499799 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e49ae3a2-1810-4760-a7d8-8e34d82295ea tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1471 microversion: 2.1 time: 0.151242 Sep 09 21:29:08.500351 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 227/441] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:08 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:08.827055 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:08.827690 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:08.836106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:08.836592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:08.837032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:08.837723 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:08.838180 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:08.838608 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:08.972209 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:08.980735 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:08.982199 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:08.983325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d16aae0e-5880-4787-8985-2344c9767805 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.160557 Sep 09 21:29:08.983908 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 215/442] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:08 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:09.522325 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ac9a88b7-42ab-4182-9b65-1bcf4cc536b8 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:09.522928 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ac9a88b7-42ab-4182-9b65-1bcf4cc536b8 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:09.529359 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac9a88b7-42ab-4182-9b65-1bcf4cc536b8 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:09.529840 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac9a88b7-42ab-4182-9b65-1bcf4cc536b8 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:09.530267 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac9a88b7-42ab-4182-9b65-1bcf4cc536b8 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:09.530978 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac9a88b7-42ab-4182-9b65-1bcf4cc536b8 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:09.531428 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac9a88b7-42ab-4182-9b65-1bcf4cc536b8 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:09.531878 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ac9a88b7-42ab-4182-9b65-1bcf4cc536b8 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:09.605461 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-70b2eb9f-17aa-4566-908b-274bdbc96b50 req-f295a9f1-4f23-48bc-a6ad-3f259eedb1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb55d12-05c7-46ea-90fd-7bd4228c5aca", "name": "network-vif-deleted", "tag": "0c869823-66ef-478f-abda-022d6694e58a"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:29:09.616808 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-70b2eb9f-17aa-4566-908b-274bdbc96b50 req-f295a9f1-4f23-48bc-a6ad-3f259eedb1f5 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:09.617288 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-70b2eb9f-17aa-4566-908b-274bdbc96b50 req-f295a9f1-4f23-48bc-a6ad-3f259eedb1f5 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:09.617995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-70b2eb9f-17aa-4566-908b-274bdbc96b50 req-f295a9f1-4f23-48bc-a6ad-3f259eedb1f5 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:09.624136 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ac9a88b7-42ab-4182-9b65-1bcf4cc536b8 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95558d9a28bf4a0bac9dd72445999781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '767cd74e36bf4ebb8e30b6f82d2a9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:09.634584 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ac9a88b7-42ab-4182-9b65-1bcf4cc536b8 tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 200 len: 1429 microversion: 2.1 time: 0.115982 Sep 09 21:29:09.635182 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 228/443] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:09 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:09.643025 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-70b2eb9f-17aa-4566-908b-274bdbc96b50 req-f295a9f1-4f23-48bc-a6ad-3f259eedb1f5 service nova] Creating event network-vif-deleted:0c869823-66ef-478f-abda-022d6694e58a for instance cfb55d12-05c7-46ea-90fd-7bd4228c5aca on hv-cinder-85221 Sep 09 21:29:09.649349 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-70b2eb9f-17aa-4566-908b-274bdbc96b50 req-f295a9f1-4f23-48bc-a6ad-3f259eedb1f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049009 Sep 09 21:29:09.650703 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 216/444] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:29:10.010411 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:10.011485 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:10.018610 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:10.019292 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:10.019936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:10.020694 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:10.021287 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:10.021569 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:10.161077 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:10.169621 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:10.171053 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:10.172239 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1e4154e9-56cd-48bf-bdfe-6e33a595ce44 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.165730 Sep 09 21:29:10.172792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 229/445] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:10 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:10.658281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:10.659247 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] [instance: cfb55d12-05c7-46ea-90fd-7bd4228c5aca] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:10.665368 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:10.665855 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:10.666297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:10.666983 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:10.667441 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:10.667907 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:10.681249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] HTTP exception thrown: Instance cfb55d12-05c7-46ea-90fd-7bd4228c5aca could not be found. Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Request method failure captured: Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca HTTP/1.1 Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7AJgYFefH-rx-qy3hxs33JVj1-mk2uR_Wr2Ok6wyarI1npusi32vOWmgWRU_j1uJE3ybnVmJMZmnCybdVO4EXfqEGr4kz1WXe4HGcK6K-P1tQ97xiYBnnxBt0JG8Y6vkp3u18BQoQpAZfQFHu3Rc6fDjfd1KTpo_TA7eSwWUyf1FBE Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 767cd74e36bf4ebb8e30b6f82d2a9164 Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesNegativeTest-549097073 Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:29:10.682835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_767cd74e36bf4ebb8e30b6f82d2a9164", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/767cd74e36bf4ebb8e30b6f82d2a9164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/767cd74e36bf4ebb8e30b6f82d2a9164"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/767cd74e36bf4ebb8e30b6f82d2a9164"}]}] Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesNegativeTest-549097073 Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 767cd74e36bf4ebb8e30b6f82d2a9164 Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesNegativeTest-549097073 Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesNegativeTest-549097073-project Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 95558d9a28bf4a0bac9dd72445999781 Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesNegativeTest-549097073-project Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance cfb55d12-05c7-46ea-90fd-7bd4228c5aca could not be found. Sep 09 21:29:10.684415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': 'cfb55d12-05c7-46ea-90fd-7bd4228c5aca'} Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb55d12-05c7-46ea-90fd-7bd4228c5aca could not be found. Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:29:10.685423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb55d12-05c7-46ea-90fd-7bd4228c5aca could not be found. Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb55d12-05c7-46ea-90fd-7bd4228c5aca could not be found. Sep 09 21:29:10.686901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:29:10.688307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] Returning 404 to user: Instance cfb55d12-05c7-46ea-90fd-7bd4228c5aca could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:29:10.688307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-da45e539-96b6-4e48-957c-ac928d59c39c tempest-VolumesNegativeTest-549097073 tempest-VolumesNegativeTest-549097073-project] 10.222.0.46 "GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca" status: 404 len: 111 microversion: 2.1 time: 0.030653 Sep 09 21:29:10.688307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 217/446] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:10 2022] GET /compute/v2.1/servers/cfb55d12-05c7-46ea-90fd-7bd4228c5aca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:29:11.202387 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:11.204789 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:11.215964 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:11.216953 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:11.217561 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:11.218427 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:11.219031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:11.219629 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:11.427256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:11.436958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:11.438689 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:11.439922 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7b718e62-71a0-4619-b792-a3dd102e5740 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.245004 Sep 09 21:29:11.440477 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 230/447] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:11 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:12.466832 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:12.467525 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:12.474730 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:12.475229 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:12.475711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:12.476418 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:12.477160 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:12.477605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:12.625157 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:12.655212 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:12.656706 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:12.657882 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d162fab4-4fe1-4129-89ff-d56994f804c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.195971 Sep 09 21:29:12.659025 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 218/448] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:12 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:13.684098 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:13.685273 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:13.694506 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:13.695348 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:13.695911 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:13.700783 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:13.700783 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:13.700783 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:13.858551 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:13.875114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:13.877379 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:13.885711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-916b83b0-2e2c-4cf1-8297-a3ad3598fded tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.205885 Sep 09 21:29:13.889966 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 231/449] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:13 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:29:14.916018 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:14.916757 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:14.924643 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:14.925343 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:14.925795 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:14.926802 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:14.927269 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:14.928425 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:15.075148 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:15.088259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:15.090301 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:15.092583 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b02c1357-3264-4413-8b64-113dac69e6ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.180566 Sep 09 21:29:15.093230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 219/450] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:14 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:16.121325 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:16.121941 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:16.129087 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:16.129580 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:16.130017 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:16.130741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:16.131228 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:16.131792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:16.294003 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:16.304284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:16.306601 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:16.307943 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8959c39d-6458-4273-93ec-ab9303199bda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.190773 Sep 09 21:29:16.308873 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 232/451] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:16 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:17.340857 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:17.342484 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:17.350389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:17.351215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:17.351894 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:17.352816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:17.353474 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:17.353970 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:17.511938 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:17.521592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:17.522942 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:17.524161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d05ff18c-515b-4069-b87a-531950a94515 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.193137 Sep 09 21:29:17.524712 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 220/452] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:17 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:18.552039 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:18.552815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:18.559397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:18.559916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:18.560359 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:18.561061 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:18.561516 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:18.561939 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:18.700132 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:18.709426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:18.710943 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:18.712184 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6cd6b810-a338-4dfd-951d-21a7dbebe9bc tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.164518 Sep 09 21:29:18.712788 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 233/453] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:18 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:18.874723 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-513152274", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "networks": [{"uuid": "c6f59f42-2692-4aed-8992-d210e59acc4e"}]}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:29:18.932519 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] validate_networks() for [('c6f59f42-2692-4aed-8992-d210e59acc4e', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:29:19.310398 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:29:19.310815 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:29:19.311286 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:29:19.311723 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:29:19.312133 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:29:19.314249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:19.323289 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:19.323820 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:19.324236 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:19.324957 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:19.325412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:19.325834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:19.354713 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Getting quotas for project cb5effc588a44c458bd5bab9b1448b87. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:29:19.358916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Getting quotas for user 04f32e144d6a4957b8c65befbce1f75a and project cb5effc588a44c458bd5bab9b1448b87. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:29:19.370452 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:29:19.372758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:29:19.420507 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-15f59dda-7c4b-41ef-b439-a0cf7bfb1ebb tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549887 Sep 09 21:29:19.421374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 221/454] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:29:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:29:19.432442 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-35bda177-bae3-46dc-98d2-6544609b9e56 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:19.433052 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-35bda177-bae3-46dc-98d2-6544609b9e56 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:19.487043 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-35bda177-bae3-46dc-98d2-6544609b9e56 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:19.497084 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-35bda177-bae3-46dc-98d2-6544609b9e56 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1218 microversion: 2.1 time: 0.067118 Sep 09 21:29:19.498545 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 234/455] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:19 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:19.741185 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:19.741824 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:19.755917 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:19.756796 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:19.757469 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:19.758415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:19.758884 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:19.759319 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:19.911513 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:19.922737 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:19.924620 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:19.925995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e599a729-fa82-45c5-b44b-0f45f0258bb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.189180 Sep 09 21:29:19.939843 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 222/456] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:19 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:20.520600 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ce6268e4-c23b-42c1-9e67-d548d6f66f57 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:20.521247 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ce6268e4-c23b-42c1-9e67-d548d6f66f57 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:20.528405 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce6268e4-c23b-42c1-9e67-d548d6f66f57 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:20.528913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce6268e4-c23b-42c1-9e67-d548d6f66f57 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:20.529334 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce6268e4-c23b-42c1-9e67-d548d6f66f57 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:20.530027 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce6268e4-c23b-42c1-9e67-d548d6f66f57 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:20.530488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce6268e4-c23b-42c1-9e67-d548d6f66f57 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:20.530952 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce6268e4-c23b-42c1-9e67-d548d6f66f57 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:20.601021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ce6268e4-c23b-42c1-9e67-d548d6f66f57 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:20.609680 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ce6268e4-c23b-42c1-9e67-d548d6f66f57 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1222 microversion: 2.1 time: 0.093185 Sep 09 21:29:20.610258 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 235/457] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:20 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:20.953943 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:20.954555 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:20.962402 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:20.963206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:20.964002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:20.964927 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:20.965578 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:20.966367 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:21.112663 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:21.121181 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:21.123044 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:21.124559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-77462ec8-54cf-4930-a9e2-9e01afabe1d1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.175350 Sep 09 21:29:21.125170 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 223/458] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:20 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:29:21.637288 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-72fb8467-4c3e-41cc-bd58-2e4de33422f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:21.638558 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-72fb8467-4c3e-41cc-bd58-2e4de33422f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:21.646459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72fb8467-4c3e-41cc-bd58-2e4de33422f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:21.647137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72fb8467-4c3e-41cc-bd58-2e4de33422f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:21.647562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72fb8467-4c3e-41cc-bd58-2e4de33422f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:21.648275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72fb8467-4c3e-41cc-bd58-2e4de33422f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:21.648726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72fb8467-4c3e-41cc-bd58-2e4de33422f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:21.649152 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-72fb8467-4c3e-41cc-bd58-2e4de33422f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:21.713274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-72fb8467-4c3e-41cc-bd58-2e4de33422f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:21.720985 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-72fb8467-4c3e-41cc-bd58-2e4de33422f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1222 microversion: 2.1 time: 0.088568 Sep 09 21:29:21.721544 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 236/459] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:21 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:22.151408 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:22.152049 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:22.158483 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:22.159725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:22.160148 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:22.160849 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:22.161282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:22.161763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:22.302796 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:22.311392 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:22.312884 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:22.314044 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1e8536bc-c858-48bf-bb75-865b9193f58f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.166545 Sep 09 21:29:22.314602 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 224/460] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:22 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:22.743502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9b347b5f-f2ed-4206-95ac-fd678f31f541 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:22.744171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9b347b5f-f2ed-4206-95ac-fd678f31f541 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:22.750507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b347b5f-f2ed-4206-95ac-fd678f31f541 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:22.750987 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b347b5f-f2ed-4206-95ac-fd678f31f541 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:22.751428 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b347b5f-f2ed-4206-95ac-fd678f31f541 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:22.752135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b347b5f-f2ed-4206-95ac-fd678f31f541 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:22.752591 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b347b5f-f2ed-4206-95ac-fd678f31f541 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:22.753817 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b347b5f-f2ed-4206-95ac-fd678f31f541 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:22.820668 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9b347b5f-f2ed-4206-95ac-fd678f31f541 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:22.829150 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9b347b5f-f2ed-4206-95ac-fd678f31f541 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1222 microversion: 2.1 time: 0.089530 Sep 09 21:29:22.829719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 237/461] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:22 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:23.340151 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:23.340724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:23.347018 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:23.347501 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:23.347965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:23.348648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:23.349106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:23.349527 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:23.476457 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:23.484870 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:23.486311 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:23.488228 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-cf88be87-0d7e-4643-949c-e9a3a2b270ef tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.152090 Sep 09 21:29:23.488779 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 225/462] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:23 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:23.853250 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-fbc71dc8-6dc8-48fe-930a-9d3919ee26b5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:23.853881 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-fbc71dc8-6dc8-48fe-930a-9d3919ee26b5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:23.860268 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fbc71dc8-6dc8-48fe-930a-9d3919ee26b5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:23.860747 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fbc71dc8-6dc8-48fe-930a-9d3919ee26b5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:23.861174 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fbc71dc8-6dc8-48fe-930a-9d3919ee26b5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:23.861845 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fbc71dc8-6dc8-48fe-930a-9d3919ee26b5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:23.862515 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fbc71dc8-6dc8-48fe-930a-9d3919ee26b5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:23.862939 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fbc71dc8-6dc8-48fe-930a-9d3919ee26b5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:23.924043 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-fbc71dc8-6dc8-48fe-930a-9d3919ee26b5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:23.933355 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-fbc71dc8-6dc8-48fe-930a-9d3919ee26b5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1222 microversion: 2.1 time: 0.083951 Sep 09 21:29:23.933912 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 238/463] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:23 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:24.513180 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:24.513814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:24.520789 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:24.521277 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:24.521715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:24.522398 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:24.522855 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:24.523281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:24.651052 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:24.659787 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:24.661259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:24.662441 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d5f78a27-36c8-42ed-bde6-4b26dc3d8fc3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.153166 Sep 09 21:29:24.663007 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 226/464] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:24 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:24.955473 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0c53db43-4083-4c02-b84b-f111fc002e09 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:24.956155 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0c53db43-4083-4c02-b84b-f111fc002e09 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:24.958524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:24.963826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0c53db43-4083-4c02-b84b-f111fc002e09 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:24.964304 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0c53db43-4083-4c02-b84b-f111fc002e09 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:24.964733 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0c53db43-4083-4c02-b84b-f111fc002e09 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:24.965447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0c53db43-4083-4c02-b84b-f111fc002e09 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:24.965901 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0c53db43-4083-4c02-b84b-f111fc002e09 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:24.966325 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0c53db43-4083-4c02-b84b-f111fc002e09 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:25.030440 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0c53db43-4083-4c02-b84b-f111fc002e09 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:25.034795 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=100 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:25.039726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0c53db43-4083-4c02-b84b-f111fc002e09 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1222 microversion: 2.1 time: 0.088058 Sep 09 21:29:25.040286 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 239/465] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:24 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:25.688307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:25.688915 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:25.696078 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:25.696558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:25.696991 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:25.697668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:25.698115 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:25.698537 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:25.833269 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:25.841685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:25.843110 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:25.844278 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a7914876-9b2e-44fd-af12-3c986476f22e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.159897 Sep 09 21:29:25.859681 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 227/466] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:25 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:26.062384 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4bfca87d-1b44-4426-893f-c969f54f6701 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:26.062993 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4bfca87d-1b44-4426-893f-c969f54f6701 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:26.070462 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bfca87d-1b44-4426-893f-c969f54f6701 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:26.070947 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bfca87d-1b44-4426-893f-c969f54f6701 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:26.071384 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bfca87d-1b44-4426-893f-c969f54f6701 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:26.072095 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bfca87d-1b44-4426-893f-c969f54f6701 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:26.072547 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bfca87d-1b44-4426-893f-c969f54f6701 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:26.072971 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4bfca87d-1b44-4426-893f-c969f54f6701 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:26.135016 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4bfca87d-1b44-4426-893f-c969f54f6701 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:26.142533 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4bfca87d-1b44-4426-893f-c969f54f6701 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1222 microversion: 2.1 time: 0.084024 Sep 09 21:29:26.143086 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 240/467] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:26 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:26.870323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:26.870935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:26.877284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:26.878468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:26.878938 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:26.879646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:26.880100 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:26.880520 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:27.010530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:27.019392 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:27.020864 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:27.022050 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e5ddb78f-c060-4704-972d-c7d027147293 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.155663 Sep 09 21:29:27.022614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 228/468] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:26 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:27.165981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c5fd760b-5413-485f-831e-bf1526f6563b tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:27.166774 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c5fd760b-5413-485f-831e-bf1526f6563b tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:27.177496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c5fd760b-5413-485f-831e-bf1526f6563b tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:27.177984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c5fd760b-5413-485f-831e-bf1526f6563b tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:27.178424 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c5fd760b-5413-485f-831e-bf1526f6563b tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:27.179118 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c5fd760b-5413-485f-831e-bf1526f6563b tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:27.179605 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c5fd760b-5413-485f-831e-bf1526f6563b tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:27.180035 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c5fd760b-5413-485f-831e-bf1526f6563b tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:27.239962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c5fd760b-5413-485f-831e-bf1526f6563b tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:27.247443 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c5fd760b-5413-485f-831e-bf1526f6563b tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1222 microversion: 2.1 time: 0.085464 Sep 09 21:29:27.248035 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 241/469] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:27 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:28.046780 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:28.047333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:28.053986 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:28.054467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:28.054905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:28.055610 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:28.056064 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:28.056483 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:28.224007 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:28.232769 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:28.234224 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:28.235403 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d5ff7236-fa49-49df-9d65-35a74a3891b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.192531 Sep 09 21:29:28.235999 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 229/470] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:28 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:28.270554 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c60a8925-3973-424d-99bb-0b0a75a41382 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:28.271178 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c60a8925-3973-424d-99bb-0b0a75a41382 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:28.278382 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c60a8925-3973-424d-99bb-0b0a75a41382 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:28.279155 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c60a8925-3973-424d-99bb-0b0a75a41382 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:28.279836 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c60a8925-3973-424d-99bb-0b0a75a41382 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:28.280757 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c60a8925-3973-424d-99bb-0b0a75a41382 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:28.281484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c60a8925-3973-424d-99bb-0b0a75a41382 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:28.282148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c60a8925-3973-424d-99bb-0b0a75a41382 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:28.382370 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c60a8925-3973-424d-99bb-0b0a75a41382 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:28.390892 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c60a8925-3973-424d-99bb-0b0a75a41382 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1278 microversion: 2.1 time: 0.124755 Sep 09 21:29:28.391806 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 242/471] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:28 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:29.262325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:29.263017 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:29.270820 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:29.271393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:29.271932 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:29.272833 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:29.273297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:29.273723 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:29.334697 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:29.365508 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:29.415804 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-651e3304-5e74-41e4-877b-a72c7413ae8d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:29.416434 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-651e3304-5e74-41e4-877b-a72c7413ae8d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:29.422438 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:29.422958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-651e3304-5e74-41e4-877b-a72c7413ae8d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:29.423524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-651e3304-5e74-41e4-877b-a72c7413ae8d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:29.424104 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-651e3304-5e74-41e4-877b-a72c7413ae8d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:29.424912 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-651e3304-5e74-41e4-877b-a72c7413ae8d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:29.425898 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-651e3304-5e74-41e4-877b-a72c7413ae8d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:29.425898 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-651e3304-5e74-41e4-877b-a72c7413ae8d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:29.430979 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:29.432452 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:29.433614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-83a160bf-f81a-4136-8ffd-cd638569d43e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.175196 Sep 09 21:29:29.434540 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 230/472] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:29 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:29.495938 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:29.668607 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-651e3304-5e74-41e4-877b-a72c7413ae8d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:29.676722 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-651e3304-5e74-41e4-877b-a72c7413ae8d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1318 microversion: 2.1 time: 0.264941 Sep 09 21:29:29.677297 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 243/473] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:29 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:29.851105 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-36331ef5-1347-4181-881c-8a88228308b2 req-27497211-496f-4a9c-b96d-41bb1b8110e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b4721b-435a-40f4-a1fe-e989e9bb8e96", "tag": "890fbbf1-040a-47ec-9a88-f51c98cf6f0b"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:29:29.861378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-36331ef5-1347-4181-881c-8a88228308b2 req-27497211-496f-4a9c-b96d-41bb1b8110e9 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:29.862021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-36331ef5-1347-4181-881c-8a88228308b2 req-27497211-496f-4a9c-b96d-41bb1b8110e9 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:29.862764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-36331ef5-1347-4181-881c-8a88228308b2 req-27497211-496f-4a9c-b96d-41bb1b8110e9 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:29.875193 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-36331ef5-1347-4181-881c-8a88228308b2 req-27497211-496f-4a9c-b96d-41bb1b8110e9 service nova] Creating event network-changed:890fbbf1-040a-47ec-9a88-f51c98cf6f0b for instance e7b4721b-435a-40f4-a1fe-e989e9bb8e96 on hv-cinder-85221 Sep 09 21:29:29.880709 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-36331ef5-1347-4181-881c-8a88228308b2 req-27497211-496f-4a9c-b96d-41bb1b8110e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034170 Sep 09 21:29:29.881506 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 231/474] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:29:30.460703 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:30.461303 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:30.467780 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:30.468268 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:30.468706 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:30.469399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:30.469856 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:30.470286 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:30.603842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:30.613003 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:30.614423 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:30.615572 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c1ac6a9a-8b65-4666-9af3-faacdcbe44d8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.158821 Sep 09 21:29:30.616120 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 244/475] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:30 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:30.700853 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-23eefb86-1840-46d6-83c0-af9858b572bf tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:30.701558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-23eefb86-1840-46d6-83c0-af9858b572bf tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:30.707995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23eefb86-1840-46d6-83c0-af9858b572bf tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:30.708482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23eefb86-1840-46d6-83c0-af9858b572bf tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:30.708934 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23eefb86-1840-46d6-83c0-af9858b572bf tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:30.709602 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23eefb86-1840-46d6-83c0-af9858b572bf tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:30.710062 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23eefb86-1840-46d6-83c0-af9858b572bf tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:30.710491 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-23eefb86-1840-46d6-83c0-af9858b572bf tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:30.842186 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-23eefb86-1840-46d6-83c0-af9858b572bf tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:30.850070 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-23eefb86-1840-46d6-83c0-af9858b572bf tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1318 microversion: 2.1 time: 0.153892 Sep 09 21:29:30.850634 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 232/476] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:30 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:31.641421 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:31.642027 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:31.649000 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:31.649477 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:31.649906 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:31.650585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:31.651032 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:31.651451 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:31.776999 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:31.786386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:31.787842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:31.788986 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e404b836-b92f-4774-a98d-33bfc13a14b0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.151427 Sep 09 21:29:31.789543 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 245/477] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:31 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:31.873470 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9e7d537f-0357-44f7-a94d-851930cec054 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:31.874077 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9e7d537f-0357-44f7-a94d-851930cec054 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:31.880896 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e7d537f-0357-44f7-a94d-851930cec054 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:31.881376 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e7d537f-0357-44f7-a94d-851930cec054 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:31.881811 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e7d537f-0357-44f7-a94d-851930cec054 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:31.882485 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e7d537f-0357-44f7-a94d-851930cec054 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:31.882936 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e7d537f-0357-44f7-a94d-851930cec054 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:31.883357 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e7d537f-0357-44f7-a94d-851930cec054 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:32.009748 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-9e7d537f-0357-44f7-a94d-851930cec054 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:32.017431 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9e7d537f-0357-44f7-a94d-851930cec054 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1318 microversion: 2.1 time: 0.147724 Sep 09 21:29:32.018066 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 233/478] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:31 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:32.814562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:32.815855 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:32.822408 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:32.822888 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:32.823322 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:32.824029 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:32.824490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:32.824912 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:32.956812 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:32.965263 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:32.966688 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:32.967857 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-11919307-fc27-448d-bea5-b8f6034aff52 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.157213 Sep 09 21:29:32.968412 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 246/479] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:32 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:33.040257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-07011ae7-82e8-43d6-9a6f-a86001773d01 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:33.040873 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-07011ae7-82e8-43d6-9a6f-a86001773d01 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:33.047232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-07011ae7-82e8-43d6-9a6f-a86001773d01 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:33.047753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-07011ae7-82e8-43d6-9a6f-a86001773d01 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:33.048191 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-07011ae7-82e8-43d6-9a6f-a86001773d01 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:33.048873 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-07011ae7-82e8-43d6-9a6f-a86001773d01 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:33.049877 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-07011ae7-82e8-43d6-9a6f-a86001773d01 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:33.050332 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-07011ae7-82e8-43d6-9a6f-a86001773d01 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:33.053097 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=100 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:29:33.189694 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-07011ae7-82e8-43d6-9a6f-a86001773d01 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:33.197924 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-07011ae7-82e8-43d6-9a6f-a86001773d01 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1318 microversion: 2.1 time: 0.161481 Sep 09 21:29:33.198488 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 234/480] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:33 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:33.993202 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:33.993776 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:34.000085 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:34.000562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:34.000990 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:34.001659 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:34.002115 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:34.002531 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:34.130092 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:34.138558 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:34.140055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:34.141211 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b2b43607-f437-4093-b20a-a8dfd43a84c1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.151930 Sep 09 21:29:34.141752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 247/481] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:33 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:34.220707 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-12b64617-6d59-4365-affb-c56c7582e0c3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:34.221999 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-12b64617-6d59-4365-affb-c56c7582e0c3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:34.228560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12b64617-6d59-4365-affb-c56c7582e0c3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:34.229043 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12b64617-6d59-4365-affb-c56c7582e0c3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:34.229565 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12b64617-6d59-4365-affb-c56c7582e0c3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:34.230253 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12b64617-6d59-4365-affb-c56c7582e0c3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:34.230743 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12b64617-6d59-4365-affb-c56c7582e0c3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:34.231167 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12b64617-6d59-4365-affb-c56c7582e0c3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:34.356675 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-12b64617-6d59-4365-affb-c56c7582e0c3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:34.364477 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-12b64617-6d59-4365-affb-c56c7582e0c3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1318 microversion: 2.1 time: 0.147643 Sep 09 21:29:34.365037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 235/482] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:34 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:35.166110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:35.166724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:35.173197 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:35.173680 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:35.174641 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:35.175548 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:35.176020 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:35.176450 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:35.310848 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:35.320673 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:35.322099 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:35.323260 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3472d1f8-f0f5-41ac-b08e-c7e6397d58ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.161054 Sep 09 21:29:35.323849 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 248/483] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:35 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:35.386310 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8ab26e1b-c048-40ab-97bc-61b9db3cff5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:35.386856 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8ab26e1b-c048-40ab-97bc-61b9db3cff5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:35.393404 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ab26e1b-c048-40ab-97bc-61b9db3cff5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:35.393897 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ab26e1b-c048-40ab-97bc-61b9db3cff5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:35.394328 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ab26e1b-c048-40ab-97bc-61b9db3cff5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:35.395042 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ab26e1b-c048-40ab-97bc-61b9db3cff5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:35.395690 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ab26e1b-c048-40ab-97bc-61b9db3cff5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:35.396111 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8ab26e1b-c048-40ab-97bc-61b9db3cff5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:35.525844 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8ab26e1b-c048-40ab-97bc-61b9db3cff5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:35.534454 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8ab26e1b-c048-40ab-97bc-61b9db3cff5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1318 microversion: 2.1 time: 0.151282 Sep 09 21:29:35.535009 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 236/484] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:35 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:36.349589 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:36.350147 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:36.356519 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:36.357001 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:36.357431 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:36.358108 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:36.358559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:36.358987 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:36.556845 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f1b04877-5285-499f-b0f9-bf644d5c8d7e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:36.557573 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f1b04877-5285-499f-b0f9-bf644d5c8d7e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:36.564190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f1b04877-5285-499f-b0f9-bf644d5c8d7e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:36.564678 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f1b04877-5285-499f-b0f9-bf644d5c8d7e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:36.565768 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f1b04877-5285-499f-b0f9-bf644d5c8d7e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:36.566474 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f1b04877-5285-499f-b0f9-bf644d5c8d7e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:36.566930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f1b04877-5285-499f-b0f9-bf644d5c8d7e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:36.567355 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f1b04877-5285-499f-b0f9-bf644d5c8d7e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:36.709343 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f1b04877-5285-499f-b0f9-bf644d5c8d7e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:36.716367 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f1b04877-5285-499f-b0f9-bf644d5c8d7e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1318 microversion: 2.1 time: 0.163352 Sep 09 21:29:36.716927 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 237/485] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:36 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:29:36.727209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:36.735725 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:36.737903 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:36.739048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3e37d83d-1a13-4759-871e-124739eb173a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.393660 Sep 09 21:29:36.739630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 249/486] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:36 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:37.646603 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-0459db9e-2ab4-49b8-9e7c-f26433f573e5 req-cece2794-b1b3-4f05-9825-61da3224ee65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b4721b-435a-40f4-a1fe-e989e9bb8e96", "name": "network-vif-plugged", "status": "completed", "tag": "890fbbf1-040a-47ec-9a88-f51c98cf6f0b"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:29:37.656437 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-0459db9e-2ab4-49b8-9e7c-f26433f573e5 req-cece2794-b1b3-4f05-9825-61da3224ee65 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:37.656920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-0459db9e-2ab4-49b8-9e7c-f26433f573e5 req-cece2794-b1b3-4f05-9825-61da3224ee65 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:37.657349 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-0459db9e-2ab4-49b8-9e7c-f26433f573e5 req-cece2794-b1b3-4f05-9825-61da3224ee65 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:37.668934 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-0459db9e-2ab4-49b8-9e7c-f26433f573e5 req-cece2794-b1b3-4f05-9825-61da3224ee65 service nova] Creating event network-vif-plugged:890fbbf1-040a-47ec-9a88-f51c98cf6f0b for instance e7b4721b-435a-40f4-a1fe-e989e9bb8e96 on hv-cinder-85221 Sep 09 21:29:37.673814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-0459db9e-2ab4-49b8-9e7c-f26433f573e5 req-cece2794-b1b3-4f05-9825-61da3224ee65 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030828 Sep 09 21:29:37.674941 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 238/487] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:29:37.739750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b0cd4d60-b6b0-4ea9-8ab4-497742810a5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:37.740447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b0cd4d60-b6b0-4ea9-8ab4-497742810a5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:37.747038 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0cd4d60-b6b0-4ea9-8ab4-497742810a5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:37.747900 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0cd4d60-b6b0-4ea9-8ab4-497742810a5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:37.748547 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0cd4d60-b6b0-4ea9-8ab4-497742810a5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:37.749446 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0cd4d60-b6b0-4ea9-8ab4-497742810a5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:37.749905 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0cd4d60-b6b0-4ea9-8ab4-497742810a5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:37.750326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0cd4d60-b6b0-4ea9-8ab4-497742810a5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:37.766040 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:37.766813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:37.773507 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:37.774018 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:37.774447 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:37.775128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:37.775605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:37.776027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:37.919635 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:37.928577 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:37.930118 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:37.931244 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a3cc5c43-b7ca-46d7-beeb-4aaf34f846a0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.169889 Sep 09 21:29:37.931922 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 239/488] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:37 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:37.935947 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b0cd4d60-b6b0-4ea9-8ab4-497742810a5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:37.945426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b0cd4d60-b6b0-4ea9-8ab4-497742810a5d tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1318 microversion: 2.1 time: 0.210733 Sep 09 21:29:37.945994 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 250/489] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:37 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:38.959031 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:38.959724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:38.966656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:38.967181 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:38.967645 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:38.968345 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:38.968804 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:38.969011 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d2c3361b-227e-4239-a7a9-e5bd9563c7a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:38.969427 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:38.969627 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d2c3361b-227e-4239-a7a9-e5bd9563c7a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:38.976821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d2c3361b-227e-4239-a7a9-e5bd9563c7a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:38.977314 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d2c3361b-227e-4239-a7a9-e5bd9563c7a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:38.977754 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d2c3361b-227e-4239-a7a9-e5bd9563c7a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:38.978447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d2c3361b-227e-4239-a7a9-e5bd9563c7a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:38.978906 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d2c3361b-227e-4239-a7a9-e5bd9563c7a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:38.979333 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d2c3361b-227e-4239-a7a9-e5bd9563c7a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:39.106593 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d2c3361b-227e-4239-a7a9-e5bd9563c7a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:39.107514 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:39.115107 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d2c3361b-227e-4239-a7a9-e5bd9563c7a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1318 microversion: 2.1 time: 0.149867 Sep 09 21:29:39.115724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 251/490] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:38 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:29:39.117348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:39.118809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:39.119993 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c5d27d20-94ae-4144-a597-6b2a493a57fb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.165575 Sep 09 21:29:39.120525 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 240/491] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:38 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:39.691342 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-86f38d92-19c2-4c43-a242-a52f7dca1f2f req-abbc1419-77dd-4d1b-973c-3d65dfc03b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8f74a7-256c-4810-944b-e4f66773aa13", "name": "network-vif-plugged", "status": "completed", "tag": "b28ee03c-d6a8-454c-b9c8-a9a10b589dbc"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:29:39.700604 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-86f38d92-19c2-4c43-a242-a52f7dca1f2f req-abbc1419-77dd-4d1b-973c-3d65dfc03b54 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:39.701079 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-86f38d92-19c2-4c43-a242-a52f7dca1f2f req-abbc1419-77dd-4d1b-973c-3d65dfc03b54 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:39.701502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-86f38d92-19c2-4c43-a242-a52f7dca1f2f req-abbc1419-77dd-4d1b-973c-3d65dfc03b54 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:39.712843 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-86f38d92-19c2-4c43-a242-a52f7dca1f2f req-abbc1419-77dd-4d1b-973c-3d65dfc03b54 service nova] Creating event network-vif-plugged:b28ee03c-d6a8-454c-b9c8-a9a10b589dbc for instance cb8f74a7-256c-4810-944b-e4f66773aa13 on hv-cinder-85221 Sep 09 21:29:39.717866 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-86f38d92-19c2-4c43-a242-a52f7dca1f2f req-abbc1419-77dd-4d1b-973c-3d65dfc03b54 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030140 Sep 09 21:29:39.718426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 252/492] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:29:40.137284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d68066c4-1692-4ea9-9840-10ede30b81c7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:40.138020 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d68066c4-1692-4ea9-9840-10ede30b81c7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:40.147045 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:40.147847 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:40.149750 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d68066c4-1692-4ea9-9840-10ede30b81c7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:40.150992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d68066c4-1692-4ea9-9840-10ede30b81c7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:40.151634 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d68066c4-1692-4ea9-9840-10ede30b81c7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:40.152924 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d68066c4-1692-4ea9-9840-10ede30b81c7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:40.153693 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d68066c4-1692-4ea9-9840-10ede30b81c7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:40.154230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d68066c4-1692-4ea9-9840-10ede30b81c7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:40.154342 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:40.154772 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:40.155235 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:40.156001 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:40.156459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:40.157030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:40.291297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d68066c4-1692-4ea9-9840-10ede30b81c7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:40.299833 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d68066c4-1692-4ea9-9840-10ede30b81c7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1507 microversion: 2.1 time: 0.165693 Sep 09 21:29:40.300415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 241/493] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:29:40 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:29:40.304525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:40.312925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:40.314436 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:40.316730 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9bdca59c-587c-4ccd-9594-8461aba9e83e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.175021 Sep 09 21:29:40.317284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 253/494] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:40 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:41.341861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:41.342478 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:41.350120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:41.350618 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:41.351060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:41.351800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:41.352259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:41.352690 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:41.508021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:41.520445 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:41.523954 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:41.525133 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4586beb8-c9c7-41e8-b8e8-4487de304634 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.187287 Sep 09 21:29:41.525686 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 242/495] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:41 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:42.551864 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:42.552488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:42.558659 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:42.559143 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:42.559603 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:42.560287 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:42.560742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:42.561164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:42.692141 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:42.700610 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:42.702035 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:42.703181 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0849909f-1944-49a8-b931-33ad80006ba8 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1810 microversion: 2.20 time: 0.155563 Sep 09 21:29:42.703765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 254/496] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:42 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:29:43.728772 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:29:43.729364 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:29:43.735927 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:43.736416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:43.736849 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:43.737534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:29:43.738008 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:29:43.738507 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:29:43.869529 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:43.878386 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:43.880569 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:29:43.881881 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d61e3c58-e477-456a-b9a2-a7d9a9fd87f9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1797 microversion: 2.20 time: 0.156949 Sep 09 21:29:43.882610 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 243/497] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:29:43 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1797 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:30:02.907946 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-cea59e1d-eb9d-4d97-b451-0e02c0b923f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b9e3fdb-3f0c-42d9-b158-fad480c62e0f", "device": "/dev/sdb"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:30:02.911102 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-cea59e1d-eb9d-4d97-b451-0e02c0b923f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:02.913727 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=31 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:02.914365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=86 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:02.920962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cea59e1d-eb9d-4d97-b451-0e02c0b923f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:02.921835 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cea59e1d-eb9d-4d97-b451-0e02c0b923f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:02.922280 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cea59e1d-eb9d-4d97-b451-0e02c0b923f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:02.922966 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cea59e1d-eb9d-4d97-b451-0e02c0b923f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:02.923420 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cea59e1d-eb9d-4d97-b451-0e02c0b923f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:02.923870 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cea59e1d-eb9d-4d97-b451-0e02c0b923f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:03.187002 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-cea59e1d-eb9d-4d97-b451-0e02c0b923f2 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "POST /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282770 Sep 09 21:30:03.187621 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 255/498] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:30:02 2022] POST /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:30:25.937147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:25.937894 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=55 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:26.106075 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-95948587-c70a-407b-aaa3-571a017b3545 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:26.106579 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-95948587-c70a-407b-aaa3-571a017b3545 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:26.112559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95948587-c70a-407b-aaa3-571a017b3545 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:26.113053 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95948587-c70a-407b-aaa3-571a017b3545 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:26.113495 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95948587-c70a-407b-aaa3-571a017b3545 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:26.114728 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95948587-c70a-407b-aaa3-571a017b3545 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:26.115211 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95948587-c70a-407b-aaa3-571a017b3545 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:26.115642 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95948587-c70a-407b-aaa3-571a017b3545 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:26.294760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-95948587-c70a-407b-aaa3-571a017b3545 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lazy-loading 'services' on Instance uuid 27906035-8bb1-450e-bb91-c40551e1a437 {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:30:26.411367 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-95948587-c70a-407b-aaa3-571a017b3545 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/os-volume_attachments/cbafbcb1-8cbb-47e8-b62c-dd18caaa094a" status: 202 len: 0 microversion: 2.1 time: 0.478359 Sep 09 21:30:26.412105 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 244/499] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:30:25 2022] DELETE /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/os-volume_attachments/cbafbcb1-8cbb-47e8-b62c-dd18caaa094a => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:30:28.601612 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:28.602524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:28.603795 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:30:28.603944 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Fri Sep 9 21:30:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/action (ip 10.222.0.46) !!! Sep 09 21:30:28.615045 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1632fbf7-a2fc-49f3-bbbd-865ec52f7931 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:30:28.622988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1632fbf7-a2fc-49f3-bbbd-865ec52f7931 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:28.623585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1632fbf7-a2fc-49f3-bbbd-865ec52f7931 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:28.624023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1632fbf7-a2fc-49f3-bbbd-865ec52f7931 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:28.683774 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1632fbf7-a2fc-49f3-bbbd-865ec52f7931 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Going to try to stop instance {{(pid=120465) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 21:30:28.731213 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1632fbf7-a2fc-49f3-bbbd-865ec52f7931 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/action" status: 202 len: 0 microversion: 2.1 time: 0.131088 Sep 09 21:30:28.734820 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 256/500] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:30:28 2022] POST /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:30:28.741295 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-521567e7-8405-49f0-84c2-20a13cb472f9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:28.741968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-521567e7-8405-49f0-84c2-20a13cb472f9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:28.749140 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-521567e7-8405-49f0-84c2-20a13cb472f9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:28.749582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-521567e7-8405-49f0-84c2-20a13cb472f9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:28.750089 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-521567e7-8405-49f0-84c2-20a13cb472f9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:28.750777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-521567e7-8405-49f0-84c2-20a13cb472f9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:28.751234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-521567e7-8405-49f0-84c2-20a13cb472f9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:28.751762 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-521567e7-8405-49f0-84c2-20a13cb472f9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:28.882780 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-521567e7-8405-49f0-84c2-20a13cb472f9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:28.890651 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-521567e7-8405-49f0-84c2-20a13cb472f9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.154225 Sep 09 21:30:28.891210 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 245/501] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:28 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:29.915522 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9d2622b9-9909-442c-adbe-ab3c8b469924 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:29.916264 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9d2622b9-9909-442c-adbe-ab3c8b469924 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:29.922796 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9d2622b9-9909-442c-adbe-ab3c8b469924 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:29.923277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9d2622b9-9909-442c-adbe-ab3c8b469924 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:29.923735 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9d2622b9-9909-442c-adbe-ab3c8b469924 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:29.924414 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9d2622b9-9909-442c-adbe-ab3c8b469924 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:29.924867 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9d2622b9-9909-442c-adbe-ab3c8b469924 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:29.925288 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9d2622b9-9909-442c-adbe-ab3c8b469924 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:30.054329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-050cbb56-c8f5-419a-92a3-663190b009c6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:30.054894 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-050cbb56-c8f5-419a-92a3-663190b009c6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:30.061567 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-050cbb56-c8f5-419a-92a3-663190b009c6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:30.062052 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-050cbb56-c8f5-419a-92a3-663190b009c6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:30.062491 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-050cbb56-c8f5-419a-92a3-663190b009c6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:30.063174 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-050cbb56-c8f5-419a-92a3-663190b009c6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:30.063648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-050cbb56-c8f5-419a-92a3-663190b009c6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:30.064070 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-050cbb56-c8f5-419a-92a3-663190b009c6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:30.112706 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9d2622b9-9909-442c-adbe-ab3c8b469924 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:30.121210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9d2622b9-9909-442c-adbe-ab3c8b469924 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.210189 Sep 09 21:30:30.135560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 257/502] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:29 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:30.149282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-050cbb56-c8f5-419a-92a3-663190b009c6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lazy-loading 'services' on Instance uuid e7b4721b-435a-40f4-a1fe-e989e9bb8e96 {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:30:30.224089 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-050cbb56-c8f5-419a-92a3-663190b009c6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96/os-volume_attachments/7b9e3fdb-3f0c-42d9-b158-fad480c62e0f" status: 202 len: 0 microversion: 2.1 time: 0.173472 Sep 09 21:30:30.224669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 246/503] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:30:30 2022] DELETE /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96/os-volume_attachments/7b9e3fdb-3f0c-42d9-b158-fad480c62e0f => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 21:30:31.146509 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8f48d7c0-224e-498d-bbb7-a463226fef94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:31.147862 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8f48d7c0-224e-498d-bbb7-a463226fef94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:31.154436 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f48d7c0-224e-498d-bbb7-a463226fef94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:31.154921 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f48d7c0-224e-498d-bbb7-a463226fef94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:31.155360 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f48d7c0-224e-498d-bbb7-a463226fef94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:31.156075 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f48d7c0-224e-498d-bbb7-a463226fef94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:31.156534 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f48d7c0-224e-498d-bbb7-a463226fef94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:31.156960 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f48d7c0-224e-498d-bbb7-a463226fef94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:31.291409 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8f48d7c0-224e-498d-bbb7-a463226fef94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:31.300902 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8f48d7c0-224e-498d-bbb7-a463226fef94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.158193 Sep 09 21:30:31.301495 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 258/504] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:31 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:31.351460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-bcb11c9f-36fc-4103-8373-480a96b53da8 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:31.352279 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-bcb11c9f-36fc-4103-8373-480a96b53da8 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:31.359752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bcb11c9f-36fc-4103-8373-480a96b53da8 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:31.360245 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bcb11c9f-36fc-4103-8373-480a96b53da8 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:31.360685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bcb11c9f-36fc-4103-8373-480a96b53da8 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:31.361381 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bcb11c9f-36fc-4103-8373-480a96b53da8 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:31.361840 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bcb11c9f-36fc-4103-8373-480a96b53da8 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:31.362267 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bcb11c9f-36fc-4103-8373-480a96b53da8 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:31.394879 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-bcb11c9f-36fc-4103-8373-480a96b53da8 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:30:31.468666 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-bcb11c9f-36fc-4103-8373-480a96b53da8 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 204 len: 0 microversion: 2.1 time: 0.122417 Sep 09 21:30:31.469251 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 247/505] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:30:31 2022] DELETE /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:30:31.477969 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b2c8b07c-422e-4dc9-9f71-d65aeba99e9f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:31.478579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b2c8b07c-422e-4dc9-9f71-d65aeba99e9f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:31.484558 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2c8b07c-422e-4dc9-9f71-d65aeba99e9f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:31.484981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2c8b07c-422e-4dc9-9f71-d65aeba99e9f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:31.485434 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2c8b07c-422e-4dc9-9f71-d65aeba99e9f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:31.486110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2c8b07c-422e-4dc9-9f71-d65aeba99e9f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:31.486562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2c8b07c-422e-4dc9-9f71-d65aeba99e9f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:31.486991 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b2c8b07c-422e-4dc9-9f71-d65aeba99e9f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:31.617889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b2c8b07c-422e-4dc9-9f71-d65aeba99e9f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:31.625457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b2c8b07c-422e-4dc9-9f71-d65aeba99e9f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1513 microversion: 2.1 time: 0.151595 Sep 09 21:30:31.626013 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 259/506] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:31 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:32.326200 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5bf9f892-b2cc-421d-a708-3d0a4ef96a34 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:32.326830 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5bf9f892-b2cc-421d-a708-3d0a4ef96a34 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:32.332756 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5bf9f892-b2cc-421d-a708-3d0a4ef96a34 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:32.333242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5bf9f892-b2cc-421d-a708-3d0a4ef96a34 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:32.333680 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5bf9f892-b2cc-421d-a708-3d0a4ef96a34 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:32.334361 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5bf9f892-b2cc-421d-a708-3d0a4ef96a34 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:32.335624 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5bf9f892-b2cc-421d-a708-3d0a4ef96a34 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:32.336246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5bf9f892-b2cc-421d-a708-3d0a4ef96a34 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:32.466006 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5bf9f892-b2cc-421d-a708-3d0a4ef96a34 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:32.473693 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5bf9f892-b2cc-421d-a708-3d0a4ef96a34 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.151802 Sep 09 21:30:32.474254 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 248/507] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:32 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:32.649447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-fea0157a-614d-4351-9311-a94c4053cf02 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:32.650129 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-fea0157a-614d-4351-9311-a94c4053cf02 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:32.656447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fea0157a-614d-4351-9311-a94c4053cf02 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:32.656928 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fea0157a-614d-4351-9311-a94c4053cf02 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:32.657368 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fea0157a-614d-4351-9311-a94c4053cf02 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:32.658309 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fea0157a-614d-4351-9311-a94c4053cf02 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:32.658765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fea0157a-614d-4351-9311-a94c4053cf02 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:32.659188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fea0157a-614d-4351-9311-a94c4053cf02 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:32.792477 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-fea0157a-614d-4351-9311-a94c4053cf02 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:32.800098 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-fea0157a-614d-4351-9311-a94c4053cf02 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1513 microversion: 2.1 time: 0.155351 Sep 09 21:30:32.800658 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 260/508] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:32 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:33.497005 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f01aa5d9-2777-4af7-8045-21f9f7a40d71 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:33.497657 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f01aa5d9-2777-4af7-8045-21f9f7a40d71 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:33.504058 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f01aa5d9-2777-4af7-8045-21f9f7a40d71 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:33.504541 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f01aa5d9-2777-4af7-8045-21f9f7a40d71 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:33.504972 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f01aa5d9-2777-4af7-8045-21f9f7a40d71 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:33.505656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f01aa5d9-2777-4af7-8045-21f9f7a40d71 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:33.506111 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f01aa5d9-2777-4af7-8045-21f9f7a40d71 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:33.506534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f01aa5d9-2777-4af7-8045-21f9f7a40d71 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:33.633277 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f01aa5d9-2777-4af7-8045-21f9f7a40d71 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:33.640998 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f01aa5d9-2777-4af7-8045-21f9f7a40d71 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.147846 Sep 09 21:30:33.641564 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 249/509] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:33 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:33.822480 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4cb3a2ea-1326-4905-9947-01e8ae0592d1 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:33.823164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4cb3a2ea-1326-4905-9947-01e8ae0592d1 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:33.829933 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4cb3a2ea-1326-4905-9947-01e8ae0592d1 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:33.830422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4cb3a2ea-1326-4905-9947-01e8ae0592d1 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:33.830976 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4cb3a2ea-1326-4905-9947-01e8ae0592d1 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:33.831787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4cb3a2ea-1326-4905-9947-01e8ae0592d1 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:33.832254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4cb3a2ea-1326-4905-9947-01e8ae0592d1 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:33.832681 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4cb3a2ea-1326-4905-9947-01e8ae0592d1 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:34.057699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4cb3a2ea-1326-4905-9947-01e8ae0592d1 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:34.065279 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4cb3a2ea-1326-4905-9947-01e8ae0592d1 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 200 len: 1513 microversion: 2.1 time: 0.246878 Sep 09 21:30:34.065844 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 261/510] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:33 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:34.302101 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-9b2bcff9-6ceb-4188-8420-e4687c1f151b req-3d1bc6ad-f621-4e96-a50a-e13d5bf44fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b4721b-435a-40f4-a1fe-e989e9bb8e96", "name": "network-vif-deleted", "tag": "890fbbf1-040a-47ec-9a88-f51c98cf6f0b"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:30:34.312578 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-9b2bcff9-6ceb-4188-8420-e4687c1f151b req-3d1bc6ad-f621-4e96-a50a-e13d5bf44fb5 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:34.313059 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-9b2bcff9-6ceb-4188-8420-e4687c1f151b req-3d1bc6ad-f621-4e96-a50a-e13d5bf44fb5 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:34.313485 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-9b2bcff9-6ceb-4188-8420-e4687c1f151b req-3d1bc6ad-f621-4e96-a50a-e13d5bf44fb5 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:34.324890 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-9b2bcff9-6ceb-4188-8420-e4687c1f151b req-3d1bc6ad-f621-4e96-a50a-e13d5bf44fb5 service nova] Creating event network-vif-deleted:890fbbf1-040a-47ec-9a88-f51c98cf6f0b for instance e7b4721b-435a-40f4-a1fe-e989e9bb8e96 on hv-cinder-85221 Sep 09 21:30:34.329649 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-9b2bcff9-6ceb-4188-8420-e4687c1f151b req-3d1bc6ad-f621-4e96-a50a-e13d5bf44fb5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031131 Sep 09 21:30:34.330329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 250/511] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:30:34.666691 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7c99828c-5fdf-437e-b2e9-30f9dd7ec3d5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:34.667310 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7c99828c-5fdf-437e-b2e9-30f9dd7ec3d5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:34.673868 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c99828c-5fdf-437e-b2e9-30f9dd7ec3d5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:34.674351 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c99828c-5fdf-437e-b2e9-30f9dd7ec3d5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:34.674814 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c99828c-5fdf-437e-b2e9-30f9dd7ec3d5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:34.675504 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c99828c-5fdf-437e-b2e9-30f9dd7ec3d5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:34.675995 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c99828c-5fdf-437e-b2e9-30f9dd7ec3d5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:34.676420 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c99828c-5fdf-437e-b2e9-30f9dd7ec3d5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:34.811231 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7c99828c-5fdf-437e-b2e9-30f9dd7ec3d5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:34.818812 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7c99828c-5fdf-437e-b2e9-30f9dd7ec3d5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.157888 Sep 09 21:30:34.819389 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 262/512] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:34 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:35.091192 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:35.091847 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: e7b4721b-435a-40f4-a1fe-e989e9bb8e96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:35.098854 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:35.099339 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:35.099805 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:35.101382 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:35.101928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:35.102362 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:35.118989 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] HTTP exception thrown: Instance e7b4721b-435a-40f4-a1fe-e989e9bb8e96 could not be found. Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Request method failure captured: Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 HTTP/1.1 Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7AtTNPdQhMRBtRxJepI0HnEZN4UHUZb7B2gXXxtpCQA0EMKrxk0gA6pxi2McYPFeeC0dJJm3j-pDVgWgWHq5iGtKT84hyLM5Z4pC3ZblhWzH8jtnTBiSpI5gckDLQX9BiSOypNZ26-W8wMeBi7Mqy_GGuINFcUkNv4ETVV-q_tIUkc Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: cb5effc588a44c458bd5bab9b1448b87 Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1678656830 Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:30:35.120656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cb5effc588a44c458bd5bab9b1448b87", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb5effc588a44c458bd5bab9b1448b87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb5effc588a44c458bd5bab9b1448b87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cb5effc588a44c458bd5bab9b1448b87"}]}] Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesSnapshotTestJSON-1678656830 Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: cb5effc588a44c458bd5bab9b1448b87 Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1678656830 Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesSnapshotTestJSON-1678656830-project Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 04f32e144d6a4957b8c65befbce1f75a Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesSnapshotTestJSON-1678656830-project Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance e7b4721b-435a-40f4-a1fe-e989e9bb8e96 could not be found. Sep 09 21:30:35.122299 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': 'e7b4721b-435a-40f4-a1fe-e989e9bb8e96'} Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7b4721b-435a-40f4-a1fe-e989e9bb8e96 could not be found. Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:30:35.126539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7b4721b-435a-40f4-a1fe-e989e9bb8e96 could not be found. Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7b4721b-435a-40f4-a1fe-e989e9bb8e96 could not be found. Sep 09 21:30:35.128128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:30:35.129691 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Returning 404 to user: Instance e7b4721b-435a-40f4-a1fe-e989e9bb8e96 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:30:35.129691 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-57ab5eb3-9c8d-437b-a44b-31b4033aaae5 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96" status: 404 len: 111 microversion: 2.1 time: 0.035716 Sep 09 21:30:35.129691 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 251/513] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:35 2022] GET /compute/v2.1/servers/e7b4721b-435a-40f4-a1fe-e989e9bb8e96 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:30:35.842323 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4717ba9f-585e-4ad4-8eb8-3d7d99d2d63e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:35.842930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4717ba9f-585e-4ad4-8eb8-3d7d99d2d63e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:35.849319 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4717ba9f-585e-4ad4-8eb8-3d7d99d2d63e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:35.849806 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4717ba9f-585e-4ad4-8eb8-3d7d99d2d63e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:35.850270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4717ba9f-585e-4ad4-8eb8-3d7d99d2d63e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:35.851023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4717ba9f-585e-4ad4-8eb8-3d7d99d2d63e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:35.851476 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4717ba9f-585e-4ad4-8eb8-3d7d99d2d63e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:35.851923 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4717ba9f-585e-4ad4-8eb8-3d7d99d2d63e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:35.978891 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4717ba9f-585e-4ad4-8eb8-3d7d99d2d63e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:35.986419 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4717ba9f-585e-4ad4-8eb8-3d7d99d2d63e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.147966 Sep 09 21:30:35.986974 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 263/514] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:35 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:37.011038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b6f0980b-2817-4327-8c1e-f1075861dbad tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:37.011678 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b6f0980b-2817-4327-8c1e-f1075861dbad tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:37.018312 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6f0980b-2817-4327-8c1e-f1075861dbad tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:37.018802 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6f0980b-2817-4327-8c1e-f1075861dbad tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:37.019235 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6f0980b-2817-4327-8c1e-f1075861dbad tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:37.019953 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6f0980b-2817-4327-8c1e-f1075861dbad tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:37.020409 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6f0980b-2817-4327-8c1e-f1075861dbad tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:37.020835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6f0980b-2817-4327-8c1e-f1075861dbad tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:37.154892 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b6f0980b-2817-4327-8c1e-f1075861dbad tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:37.163155 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b6f0980b-2817-4327-8c1e-f1075861dbad tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.156695 Sep 09 21:30:37.163729 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 252/515] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:37 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:38.186931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b4f6a72e-9cfa-461e-a966-13439a0123e7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:38.187556 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b4f6a72e-9cfa-461e-a966-13439a0123e7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:38.193962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4f6a72e-9cfa-461e-a966-13439a0123e7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:38.194668 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4f6a72e-9cfa-461e-a966-13439a0123e7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:38.195110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4f6a72e-9cfa-461e-a966-13439a0123e7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:38.195827 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4f6a72e-9cfa-461e-a966-13439a0123e7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:38.196290 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4f6a72e-9cfa-461e-a966-13439a0123e7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:38.196719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4f6a72e-9cfa-461e-a966-13439a0123e7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:38.327162 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b4f6a72e-9cfa-461e-a966-13439a0123e7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:38.336193 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b4f6a72e-9cfa-461e-a966-13439a0123e7 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.152805 Sep 09 21:30:38.336770 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 264/516] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:38 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:39.359328 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c81de6db-e05c-4746-8cb5-fd5a7a583ed5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:39.359973 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c81de6db-e05c-4746-8cb5-fd5a7a583ed5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:39.367959 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c81de6db-e05c-4746-8cb5-fd5a7a583ed5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:39.368445 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c81de6db-e05c-4746-8cb5-fd5a7a583ed5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:39.368886 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c81de6db-e05c-4746-8cb5-fd5a7a583ed5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:39.369607 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c81de6db-e05c-4746-8cb5-fd5a7a583ed5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:39.370063 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c81de6db-e05c-4746-8cb5-fd5a7a583ed5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:39.370510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c81de6db-e05c-4746-8cb5-fd5a7a583ed5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:39.502107 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c81de6db-e05c-4746-8cb5-fd5a7a583ed5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:39.510026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c81de6db-e05c-4746-8cb5-fd5a7a583ed5 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.154549 Sep 09 21:30:39.510586 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 253/517] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:39 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:40.533797 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f70cae9e-d3af-40ce-aedb-e1837a18cf0a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:40.534291 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f70cae9e-d3af-40ce-aedb-e1837a18cf0a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:40.541774 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f70cae9e-d3af-40ce-aedb-e1837a18cf0a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:40.542149 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f70cae9e-d3af-40ce-aedb-e1837a18cf0a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:40.542901 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f70cae9e-d3af-40ce-aedb-e1837a18cf0a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:40.543760 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f70cae9e-d3af-40ce-aedb-e1837a18cf0a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:40.544496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f70cae9e-d3af-40ce-aedb-e1837a18cf0a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:40.544932 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f70cae9e-d3af-40ce-aedb-e1837a18cf0a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:40.691509 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f70cae9e-d3af-40ce-aedb-e1837a18cf0a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:40.699490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f70cae9e-d3af-40ce-aedb-e1837a18cf0a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.169866 Sep 09 21:30:40.700086 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 265/518] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:40 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:41.724356 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4bead625-d432-4643-93ad-b235b3b88393 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:41.725626 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4bead625-d432-4643-93ad-b235b3b88393 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:41.731972 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bead625-d432-4643-93ad-b235b3b88393 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:41.732464 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bead625-d432-4643-93ad-b235b3b88393 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:41.732891 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bead625-d432-4643-93ad-b235b3b88393 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:41.733572 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bead625-d432-4643-93ad-b235b3b88393 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:41.734024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bead625-d432-4643-93ad-b235b3b88393 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:41.734442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bead625-d432-4643-93ad-b235b3b88393 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:41.885823 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4bead625-d432-4643-93ad-b235b3b88393 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:41.895282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4bead625-d432-4643-93ad-b235b3b88393 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.175736 Sep 09 21:30:41.896263 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 254/519] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:41 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:42.919819 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8a4ebb1a-3018-4838-8ae3-4f82ecc01045 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:42.920435 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8a4ebb1a-3018-4838-8ae3-4f82ecc01045 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:42.926341 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb1a-3018-4838-8ae3-4f82ecc01045 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:42.926833 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb1a-3018-4838-8ae3-4f82ecc01045 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:42.927278 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb1a-3018-4838-8ae3-4f82ecc01045 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:42.928044 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb1a-3018-4838-8ae3-4f82ecc01045 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:42.928630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb1a-3018-4838-8ae3-4f82ecc01045 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:42.929059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb1a-3018-4838-8ae3-4f82ecc01045 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:43.054848 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8a4ebb1a-3018-4838-8ae3-4f82ecc01045 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:43.062575 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8a4ebb1a-3018-4838-8ae3-4f82ecc01045 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.146875 Sep 09 21:30:43.063141 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 266/520] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:42 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:43.702311 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b3f572aa-1394-492e-af99-761b86d86b6d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "549d0545-6dfe-4767-aab7-0c3ca11939bb"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:30:43.705619 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b3f572aa-1394-492e-af99-761b86d86b6d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:43.712664 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3f572aa-1394-492e-af99-761b86d86b6d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:43.713156 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3f572aa-1394-492e-af99-761b86d86b6d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:43.713597 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3f572aa-1394-492e-af99-761b86d86b6d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:43.714304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3f572aa-1394-492e-af99-761b86d86b6d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:43.714786 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3f572aa-1394-492e-af99-761b86d86b6d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:43.715219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3f572aa-1394-492e-af99-761b86d86b6d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:44.086559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2a3ee5da-94fd-4598-b230-7e2c4a1be95f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:44.087376 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2a3ee5da-94fd-4598-b230-7e2c4a1be95f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:44.093749 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2a3ee5da-94fd-4598-b230-7e2c4a1be95f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:44.094240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2a3ee5da-94fd-4598-b230-7e2c4a1be95f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:44.094673 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2a3ee5da-94fd-4598-b230-7e2c4a1be95f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:44.095363 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2a3ee5da-94fd-4598-b230-7e2c4a1be95f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:44.095861 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2a3ee5da-94fd-4598-b230-7e2c4a1be95f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:44.096450 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2a3ee5da-94fd-4598-b230-7e2c4a1be95f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:44.232829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2a3ee5da-94fd-4598-b230-7e2c4a1be95f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:44.240653 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2a3ee5da-94fd-4598-b230-7e2c4a1be95f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.158276 Sep 09 21:30:44.241215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 267/521] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:44 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:30:45.264432 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f17527fd-0350-4896-a3f4-1b36353cdeff tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:45.265055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f17527fd-0350-4896-a3f4-1b36353cdeff tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:45.271502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f17527fd-0350-4896-a3f4-1b36353cdeff tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:45.272011 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f17527fd-0350-4896-a3f4-1b36353cdeff tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:45.272444 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f17527fd-0350-4896-a3f4-1b36353cdeff tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:45.273118 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f17527fd-0350-4896-a3f4-1b36353cdeff tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:45.273571 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f17527fd-0350-4896-a3f4-1b36353cdeff tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:45.273988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f17527fd-0350-4896-a3f4-1b36353cdeff tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:45.405393 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f17527fd-0350-4896-a3f4-1b36353cdeff tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:45.414117 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f17527fd-0350-4896-a3f4-1b36353cdeff tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1678 microversion: 2.1 time: 0.153653 Sep 09 21:30:45.414680 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 268/522] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:45 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:30:45.996883 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b3f572aa-1394-492e-af99-761b86d86b6d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.298043 Sep 09 21:30:45.997476 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 255/523] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:30:43 2022] POST /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments => generated 194 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:30:46.437464 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6eee5c77-c405-4f28-a575-d94036b8d2e1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:46.438008 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6eee5c77-c405-4f28-a575-d94036b8d2e1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:46.444720 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6eee5c77-c405-4f28-a575-d94036b8d2e1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:46.445160 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6eee5c77-c405-4f28-a575-d94036b8d2e1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:46.445671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6eee5c77-c405-4f28-a575-d94036b8d2e1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:46.446325 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6eee5c77-c405-4f28-a575-d94036b8d2e1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:46.446816 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6eee5c77-c405-4f28-a575-d94036b8d2e1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:46.447215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6eee5c77-c405-4f28-a575-d94036b8d2e1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:46.577378 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6eee5c77-c405-4f28-a575-d94036b8d2e1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:46.585708 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6eee5c77-c405-4f28-a575-d94036b8d2e1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1655 microversion: 2.1 time: 0.152209 Sep 09 21:30:46.586264 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 269/524] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:46 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:46.609424 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5e4b7007-abe9-44e5-af2d-6609701859d3 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:30:46.616094 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5e4b7007-abe9-44e5-af2d-6609701859d3 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:46.616569 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5e4b7007-abe9-44e5-af2d-6609701859d3 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:46.616995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5e4b7007-abe9-44e5-af2d-6609701859d3 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:46.640278 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5e4b7007-abe9-44e5-af2d-6609701859d3 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Going to try to start instance {{(pid=120466) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 21:30:46.666558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:46.685036 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5e4b7007-abe9-44e5-af2d-6609701859d3 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/action" status: 202 len: 0 microversion: 2.1 time: 0.079688 Sep 09 21:30:46.685639 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 256/525] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:30:46 2022] POST /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:30:46.696167 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bd307ccb-098d-40ee-a5e9-4521710ff914 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:46.696805 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bd307ccb-098d-40ee-a5e9-4521710ff914 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:46.707734 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd307ccb-098d-40ee-a5e9-4521710ff914 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:46.708225 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd307ccb-098d-40ee-a5e9-4521710ff914 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:46.708662 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd307ccb-098d-40ee-a5e9-4521710ff914 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:46.710202 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd307ccb-098d-40ee-a5e9-4521710ff914 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:46.710635 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd307ccb-098d-40ee-a5e9-4521710ff914 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:46.711063 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd307ccb-098d-40ee-a5e9-4521710ff914 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:46.845901 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bd307ccb-098d-40ee-a5e9-4521710ff914 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:46.854620 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bd307ccb-098d-40ee-a5e9-4521710ff914 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1664 microversion: 2.1 time: 0.164563 Sep 09 21:30:46.855297 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 270/526] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:46 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:47.062236 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-403007286", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "networks": [{"uuid": "c6f59f42-2692-4aed-8992-d210e59acc4e"}]}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:30:47.118998 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] validate_networks() for [('c6f59f42-2692-4aed-8992-d210e59acc4e', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:30:47.528903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:30:47.529332 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:30:47.529811 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:30:47.530224 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:30:47.530640 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:30:47.540153 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:47.540639 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:47.541076 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:47.541812 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:47.542273 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:47.542707 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:47.561890 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Getting quotas for project cb5effc588a44c458bd5bab9b1448b87. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:30:47.566043 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Getting quotas for user 04f32e144d6a4957b8c65befbce1f75a and project cb5effc588a44c458bd5bab9b1448b87. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:30:47.577475 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:30:47.579869 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:30:47.624148 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e7f7840c-3a0b-4c2d-95c3-78c7956355a7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566623 Sep 09 21:30:47.624957 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 257/527] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:30:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:30:47.637287 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3668c8b5-d68c-4b1a-8cf5-e93801c51634 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:47.638328 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3668c8b5-d68c-4b1a-8cf5-e93801c51634 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:47.694799 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3668c8b5-d68c-4b1a-8cf5-e93801c51634 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:47.702179 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3668c8b5-d68c-4b1a-8cf5-e93801c51634 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1218 microversion: 2.1 time: 0.069137 Sep 09 21:30:47.702747 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 271/528] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:47 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:47.880118 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1c2a0827-54cc-4929-8dfa-b2233d4c5ae9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:47.880727 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1c2a0827-54cc-4929-8dfa-b2233d4c5ae9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:47.887640 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c2a0827-54cc-4929-8dfa-b2233d4c5ae9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:47.888122 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c2a0827-54cc-4929-8dfa-b2233d4c5ae9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:47.888554 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c2a0827-54cc-4929-8dfa-b2233d4c5ae9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:47.889242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c2a0827-54cc-4929-8dfa-b2233d4c5ae9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:47.889693 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c2a0827-54cc-4929-8dfa-b2233d4c5ae9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:47.890115 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c2a0827-54cc-4929-8dfa-b2233d4c5ae9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:48.029758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1c2a0827-54cc-4929-8dfa-b2233d4c5ae9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:48.039201 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1c2a0827-54cc-4929-8dfa-b2233d4c5ae9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1664 microversion: 2.1 time: 0.163719 Sep 09 21:30:48.039930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 258/529] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:47 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:48.725532 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e3fd07f8-34ed-4dd7-9e61-2ab1fa344839 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:48.727279 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e3fd07f8-34ed-4dd7-9e61-2ab1fa344839 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:48.734449 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3fd07f8-34ed-4dd7-9e61-2ab1fa344839 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:48.734946 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3fd07f8-34ed-4dd7-9e61-2ab1fa344839 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:48.735422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3fd07f8-34ed-4dd7-9e61-2ab1fa344839 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:48.736183 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3fd07f8-34ed-4dd7-9e61-2ab1fa344839 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:48.736702 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3fd07f8-34ed-4dd7-9e61-2ab1fa344839 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:48.737131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3fd07f8-34ed-4dd7-9e61-2ab1fa344839 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:48.755330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:48.801996 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e3fd07f8-34ed-4dd7-9e61-2ab1fa344839 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:48.810135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e3fd07f8-34ed-4dd7-9e61-2ab1fa344839 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1214 microversion: 2.1 time: 0.089275 Sep 09 21:30:48.810791 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 272/530] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:48 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:49.062506 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-35b30351-226a-4ef9-8eb3-dc3009da2140 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:49.063131 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-35b30351-226a-4ef9-8eb3-dc3009da2140 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:49.070485 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35b30351-226a-4ef9-8eb3-dc3009da2140 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:49.071098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35b30351-226a-4ef9-8eb3-dc3009da2140 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:49.071563 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35b30351-226a-4ef9-8eb3-dc3009da2140 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:49.072278 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35b30351-226a-4ef9-8eb3-dc3009da2140 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:49.072744 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35b30351-226a-4ef9-8eb3-dc3009da2140 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:49.073175 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-35b30351-226a-4ef9-8eb3-dc3009da2140 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:49.204478 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-35b30351-226a-4ef9-8eb3-dc3009da2140 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:49.213221 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-35b30351-226a-4ef9-8eb3-dc3009da2140 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1668 microversion: 2.1 time: 0.154510 Sep 09 21:30:49.215037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 259/531] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:49 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:49.833448 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e55c608d-0dd4-4f85-947b-b77a5a3c35fa tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:49.834119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e55c608d-0dd4-4f85-947b-b77a5a3c35fa tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:49.841272 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e55c608d-0dd4-4f85-947b-b77a5a3c35fa tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:49.841764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e55c608d-0dd4-4f85-947b-b77a5a3c35fa tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:49.842197 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e55c608d-0dd4-4f85-947b-b77a5a3c35fa tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:49.842892 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e55c608d-0dd4-4f85-947b-b77a5a3c35fa tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:49.843349 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e55c608d-0dd4-4f85-947b-b77a5a3c35fa tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:49.843797 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e55c608d-0dd4-4f85-947b-b77a5a3c35fa tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:49.915758 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e55c608d-0dd4-4f85-947b-b77a5a3c35fa tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:49.923280 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e55c608d-0dd4-4f85-947b-b77a5a3c35fa tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1276 microversion: 2.1 time: 0.093714 Sep 09 21:30:49.923868 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 273/532] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:49 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:30:50.833283 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-90d673d9-8ca9-478e-a157-3fb1e25be1da req-6eda1e15-8c2b-469f-aa93-fd2a8685efbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7966f60-922a-45dd-a30f-104e10d5696c", "tag": "7c773c2d-d9aa-442a-9554-21bc8f82ff6b"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:30:50.844195 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-90d673d9-8ca9-478e-a157-3fb1e25be1da req-6eda1e15-8c2b-469f-aa93-fd2a8685efbc service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:50.844707 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-90d673d9-8ca9-478e-a157-3fb1e25be1da req-6eda1e15-8c2b-469f-aa93-fd2a8685efbc service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:50.845154 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-90d673d9-8ca9-478e-a157-3fb1e25be1da req-6eda1e15-8c2b-469f-aa93-fd2a8685efbc service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:50.860331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-90d673d9-8ca9-478e-a157-3fb1e25be1da req-6eda1e15-8c2b-469f-aa93-fd2a8685efbc service nova] Creating event network-changed:7c773c2d-d9aa-442a-9554-21bc8f82ff6b for instance f7966f60-922a-45dd-a30f-104e10d5696c on hv-cinder-85221 Sep 09 21:30:50.865899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-90d673d9-8ca9-478e-a157-3fb1e25be1da req-6eda1e15-8c2b-469f-aa93-fd2a8685efbc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035804 Sep 09 21:30:50.866658 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 260/533] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:30:50.946889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3393b4cd-d97d-4602-a89a-07afda343bb9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:50.947499 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3393b4cd-d97d-4602-a89a-07afda343bb9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:50.953877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3393b4cd-d97d-4602-a89a-07afda343bb9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:50.954359 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3393b4cd-d97d-4602-a89a-07afda343bb9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:50.954797 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3393b4cd-d97d-4602-a89a-07afda343bb9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:50.955480 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3393b4cd-d97d-4602-a89a-07afda343bb9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:50.955962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3393b4cd-d97d-4602-a89a-07afda343bb9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:50.956390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3393b4cd-d97d-4602-a89a-07afda343bb9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:51.167630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3393b4cd-d97d-4602-a89a-07afda343bb9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:51.175089 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3393b4cd-d97d-4602-a89a-07afda343bb9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1318 microversion: 2.1 time: 0.232817 Sep 09 21:30:51.175857 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 274/534] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:50 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:52.199815 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-352078f3-4ec7-405c-9737-c1e9021ba082 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:52.200546 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-352078f3-4ec7-405c-9737-c1e9021ba082 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:52.206626 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-352078f3-4ec7-405c-9737-c1e9021ba082 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:52.207109 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-352078f3-4ec7-405c-9737-c1e9021ba082 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:52.207561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-352078f3-4ec7-405c-9737-c1e9021ba082 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:52.208284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-352078f3-4ec7-405c-9737-c1e9021ba082 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:52.208753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-352078f3-4ec7-405c-9737-c1e9021ba082 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:52.209173 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-352078f3-4ec7-405c-9737-c1e9021ba082 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:52.341376 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-352078f3-4ec7-405c-9737-c1e9021ba082 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:52.348951 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-352078f3-4ec7-405c-9737-c1e9021ba082 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1318 microversion: 2.1 time: 0.153856 Sep 09 21:30:52.350125 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 261/535] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:52 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:30:53.372059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b7d68f54-e68c-4952-af2b-c7ffce02d6a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:53.372676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b7d68f54-e68c-4952-af2b-c7ffce02d6a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:53.379050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b7d68f54-e68c-4952-af2b-c7ffce02d6a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:53.379559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b7d68f54-e68c-4952-af2b-c7ffce02d6a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:53.380015 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b7d68f54-e68c-4952-af2b-c7ffce02d6a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:53.381223 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b7d68f54-e68c-4952-af2b-c7ffce02d6a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:53.381684 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b7d68f54-e68c-4952-af2b-c7ffce02d6a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:53.382115 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b7d68f54-e68c-4952-af2b-c7ffce02d6a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:53.517609 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b7d68f54-e68c-4952-af2b-c7ffce02d6a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:53.525891 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b7d68f54-e68c-4952-af2b-c7ffce02d6a4 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1318 microversion: 2.1 time: 0.157691 Sep 09 21:30:53.526454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 275/536] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:53 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:54.554630 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c16a5a1f-7dd1-4bac-9cb6-65821f684ba9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:54.555267 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c16a5a1f-7dd1-4bac-9cb6-65821f684ba9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:54.561592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16a5a1f-7dd1-4bac-9cb6-65821f684ba9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:54.562074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16a5a1f-7dd1-4bac-9cb6-65821f684ba9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:54.562512 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16a5a1f-7dd1-4bac-9cb6-65821f684ba9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:54.563193 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16a5a1f-7dd1-4bac-9cb6-65821f684ba9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:54.563680 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16a5a1f-7dd1-4bac-9cb6-65821f684ba9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:54.564104 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c16a5a1f-7dd1-4bac-9cb6-65821f684ba9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:54.691453 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c16a5a1f-7dd1-4bac-9cb6-65821f684ba9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:54.699978 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c16a5a1f-7dd1-4bac-9cb6-65821f684ba9 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1318 microversion: 2.1 time: 0.149612 Sep 09 21:30:54.700539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 262/537] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:54 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:30:55.724914 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8573d5ec-5646-43ad-857b-f02721d409e7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:55.726864 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8573d5ec-5646-43ad-857b-f02721d409e7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:55.736364 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8573d5ec-5646-43ad-857b-f02721d409e7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:55.737327 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8573d5ec-5646-43ad-857b-f02721d409e7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:55.737327 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8573d5ec-5646-43ad-857b-f02721d409e7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:55.737964 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8573d5ec-5646-43ad-857b-f02721d409e7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:55.738419 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8573d5ec-5646-43ad-857b-f02721d409e7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:55.738841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8573d5ec-5646-43ad-857b-f02721d409e7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:55.955978 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8573d5ec-5646-43ad-857b-f02721d409e7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:55.971386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8573d5ec-5646-43ad-857b-f02721d409e7 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1318 microversion: 2.1 time: 0.252113 Sep 09 21:30:55.972357 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 276/538] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:55 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:56.738020 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b415aab9-14ce-417b-8cfb-52e72b4500a5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:30:56.740284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b415aab9-14ce-417b-8cfb-52e72b4500a5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:56.742666 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:56.747908 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b415aab9-14ce-417b-8cfb-52e72b4500a5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:56.748392 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b415aab9-14ce-417b-8cfb-52e72b4500a5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:56.748822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b415aab9-14ce-417b-8cfb-52e72b4500a5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:56.749505 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b415aab9-14ce-417b-8cfb-52e72b4500a5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:56.749956 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b415aab9-14ce-417b-8cfb-52e72b4500a5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:56.750379 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b415aab9-14ce-417b-8cfb-52e72b4500a5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:56.774311 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-b415aab9-14ce-417b-8cfb-52e72b4500a5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lazy-loading 'flavor' on Instance uuid 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:30:56.894786 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b415aab9-14ce-417b-8cfb-52e72b4500a5 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/action" status: 200 len: 32 microversion: 2.1 time: 0.160723 Sep 09 21:30:56.895699 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 263/539] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:30:56 2022] POST /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:30:56.905143 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5beafcd8-6329-4a1d-8c78-449e5874eadb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:56.905757 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5beafcd8-6329-4a1d-8c78-449e5874eadb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:56.912852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5beafcd8-6329-4a1d-8c78-449e5874eadb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:56.913328 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5beafcd8-6329-4a1d-8c78-449e5874eadb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:56.913837 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5beafcd8-6329-4a1d-8c78-449e5874eadb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:56.914875 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5beafcd8-6329-4a1d-8c78-449e5874eadb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:56.915336 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5beafcd8-6329-4a1d-8c78-449e5874eadb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:56.915796 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5beafcd8-6329-4a1d-8c78-449e5874eadb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:56.996866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1c94e524-70db-44b3-b4a8-d5e56127cc7f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:56.997557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1c94e524-70db-44b3-b4a8-d5e56127cc7f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:57.003762 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c94e524-70db-44b3-b4a8-d5e56127cc7f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:57.004249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c94e524-70db-44b3-b4a8-d5e56127cc7f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:57.004682 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c94e524-70db-44b3-b4a8-d5e56127cc7f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:57.005434 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c94e524-70db-44b3-b4a8-d5e56127cc7f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:57.006499 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c94e524-70db-44b3-b4a8-d5e56127cc7f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:57.007119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1c94e524-70db-44b3-b4a8-d5e56127cc7f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:57.140166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-5beafcd8-6329-4a1d-8c78-449e5874eadb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:57.143395 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1c94e524-70db-44b3-b4a8-d5e56127cc7f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:57.151025 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5beafcd8-6329-4a1d-8c78-449e5874eadb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.249600 Sep 09 21:30:57.151617 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 277/540] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:56 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:57.157379 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1c94e524-70db-44b3-b4a8-d5e56127cc7f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1318 microversion: 2.1 time: 0.164710 Sep 09 21:30:57.158438 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 264/541] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:56 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:30:58.133828 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-d889b116-be96-4093-ad41-9dadb3bf5f97 req-9f231a30-4b63-4330-84c4-62b54ca748f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7966f60-922a-45dd-a30f-104e10d5696c", "name": "network-vif-plugged", "status": "completed", "tag": "7c773c2d-d9aa-442a-9554-21bc8f82ff6b"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:30:58.138919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:58.145181 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-d889b116-be96-4093-ad41-9dadb3bf5f97 req-9f231a30-4b63-4330-84c4-62b54ca748f6 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:58.145659 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-d889b116-be96-4093-ad41-9dadb3bf5f97 req-9f231a30-4b63-4330-84c4-62b54ca748f6 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:58.146722 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-d889b116-be96-4093-ad41-9dadb3bf5f97 req-9f231a30-4b63-4330-84c4-62b54ca748f6 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:58.158685 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-d889b116-be96-4093-ad41-9dadb3bf5f97 req-9f231a30-4b63-4330-84c4-62b54ca748f6 service nova] Creating event network-vif-plugged:7c773c2d-d9aa-442a-9554-21bc8f82ff6b for instance f7966f60-922a-45dd-a30f-104e10d5696c on hv-cinder-85221 Sep 09 21:30:58.163624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-d889b116-be96-4093-ad41-9dadb3bf5f97 req-9f231a30-4b63-4330-84c4-62b54ca748f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034093 Sep 09 21:30:58.164213 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 278/542] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:30:58.175347 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-7d154bcb-ab17-4ef0-8d65-3b263ad2d22b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:58.175990 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-7d154bcb-ab17-4ef0-8d65-3b263ad2d22b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:58.178679 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:58.180198 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:58.184109 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bd7d7e80-f10f-4796-bded-e0dfbb0a5e03 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:58.184862 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bd7d7e80-f10f-4796-bded-e0dfbb0a5e03 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:58.185628 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d154bcb-ab17-4ef0-8d65-3b263ad2d22b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:58.186119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d154bcb-ab17-4ef0-8d65-3b263ad2d22b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:58.186636 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d154bcb-ab17-4ef0-8d65-3b263ad2d22b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:58.187399 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d154bcb-ab17-4ef0-8d65-3b263ad2d22b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:58.187907 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d154bcb-ab17-4ef0-8d65-3b263ad2d22b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:58.188345 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d154bcb-ab17-4ef0-8d65-3b263ad2d22b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:58.191841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd7d7e80-f10f-4796-bded-e0dfbb0a5e03 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:58.192477 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd7d7e80-f10f-4796-bded-e0dfbb0a5e03 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:58.193509 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd7d7e80-f10f-4796-bded-e0dfbb0a5e03 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:58.194784 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd7d7e80-f10f-4796-bded-e0dfbb0a5e03 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:58.195257 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd7d7e80-f10f-4796-bded-e0dfbb0a5e03 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:58.195778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd7d7e80-f10f-4796-bded-e0dfbb0a5e03 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:58.340175 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bd7d7e80-f10f-4796-bded-e0dfbb0a5e03 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:58.350289 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7d154bcb-ab17-4ef0-8d65-3b263ad2d22b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:58.352160 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bd7d7e80-f10f-4796-bded-e0dfbb0a5e03 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1318 microversion: 2.1 time: 0.173484 Sep 09 21:30:58.352695 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 279/543] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:58 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:30:58.358495 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-7d154bcb-ab17-4ef0-8d65-3b263ad2d22b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.186872 Sep 09 21:30:58.359040 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 265/544] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:58 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:59.375899 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ef565ecc-d271-4610-aafb-e17213433235 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:59.376578 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ef565ecc-d271-4610-aafb-e17213433235 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:59.379129 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=51 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:30:59.382157 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-356a9512-aa50-48e0-8caf-00c16e08fba9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:30:59.382842 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-356a9512-aa50-48e0-8caf-00c16e08fba9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:30:59.384500 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ef565ecc-d271-4610-aafb-e17213433235 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:59.384992 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ef565ecc-d271-4610-aafb-e17213433235 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:59.385437 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ef565ecc-d271-4610-aafb-e17213433235 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:59.386140 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ef565ecc-d271-4610-aafb-e17213433235 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:59.386600 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ef565ecc-d271-4610-aafb-e17213433235 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:59.387031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ef565ecc-d271-4610-aafb-e17213433235 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:59.389191 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-356a9512-aa50-48e0-8caf-00c16e08fba9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:59.389670 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-356a9512-aa50-48e0-8caf-00c16e08fba9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:59.390098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-356a9512-aa50-48e0-8caf-00c16e08fba9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:59.390776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-356a9512-aa50-48e0-8caf-00c16e08fba9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:30:59.391227 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-356a9512-aa50-48e0-8caf-00c16e08fba9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:30:59.391687 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-356a9512-aa50-48e0-8caf-00c16e08fba9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:30:59.528920 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ef565ecc-d271-4610-aafb-e17213433235 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:59.538868 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ef565ecc-d271-4610-aafb-e17213433235 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1318 microversion: 2.1 time: 0.166863 Sep 09 21:30:59.539019 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-356a9512-aa50-48e0-8caf-00c16e08fba9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:30:59.539440 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 280/545] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:59 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:30:59.547207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-356a9512-aa50-48e0-8caf-00c16e08fba9 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.169096 Sep 09 21:30:59.547978 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 266/546] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:30:59 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:31:00.562644 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b6b3bce1-e693-44c1-8b64-8e32a682a817 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:00.563321 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b6b3bce1-e693-44c1-8b64-8e32a682a817 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:00.570566 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b6b3bce1-e693-44c1-8b64-8e32a682a817 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:00.571334 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-11f0b14f-3d16-4ed7-b745-0f7e087d9533 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:00.571834 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b6b3bce1-e693-44c1-8b64-8e32a682a817 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:00.571942 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b6b3bce1-e693-44c1-8b64-8e32a682a817 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:00.572598 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b6b3bce1-e693-44c1-8b64-8e32a682a817 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:00.572726 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-11f0b14f-3d16-4ed7-b745-0f7e087d9533 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:00.573197 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b6b3bce1-e693-44c1-8b64-8e32a682a817 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:00.573634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b6b3bce1-e693-44c1-8b64-8e32a682a817 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:00.579189 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11f0b14f-3d16-4ed7-b745-0f7e087d9533 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:00.579810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11f0b14f-3d16-4ed7-b745-0f7e087d9533 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:00.580246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11f0b14f-3d16-4ed7-b745-0f7e087d9533 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:00.580936 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11f0b14f-3d16-4ed7-b745-0f7e087d9533 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:00.581393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11f0b14f-3d16-4ed7-b745-0f7e087d9533 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:00.581814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-11f0b14f-3d16-4ed7-b745-0f7e087d9533 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:00.713228 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b6b3bce1-e693-44c1-8b64-8e32a682a817 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:00.723823 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-11f0b14f-3d16-4ed7-b745-0f7e087d9533 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:00.723962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b6b3bce1-e693-44c1-8b64-8e32a682a817 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1318 microversion: 2.1 time: 0.163447 Sep 09 21:31:00.723962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 281/547] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:00 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:00.732260 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-11f0b14f-3d16-4ed7-b745-0f7e087d9533 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.165193 Sep 09 21:31:00.732953 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 267/548] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:00 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:31:01.746168 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8499313b-ce2d-48d3-9165-8137738b378c tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:01.746783 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8499313b-ce2d-48d3-9165-8137738b378c tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:01.753076 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8499313b-ce2d-48d3-9165-8137738b378c tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:01.753630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8499313b-ce2d-48d3-9165-8137738b378c tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:01.754065 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8499313b-ce2d-48d3-9165-8137738b378c tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:01.754919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8499313b-ce2d-48d3-9165-8137738b378c tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:01.756400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8499313b-ce2d-48d3-9165-8137738b378c tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:01.756902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-85168620-fcbd-49f0-9320-caccee8bd851 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:01.757336 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8499313b-ce2d-48d3-9165-8137738b378c tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:01.757518 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-85168620-fcbd-49f0-9320-caccee8bd851 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:01.764698 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85168620-fcbd-49f0-9320-caccee8bd851 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:01.765187 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85168620-fcbd-49f0-9320-caccee8bd851 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:01.765627 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85168620-fcbd-49f0-9320-caccee8bd851 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:01.766318 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85168620-fcbd-49f0-9320-caccee8bd851 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:01.766770 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85168620-fcbd-49f0-9320-caccee8bd851 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:01.767192 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85168620-fcbd-49f0-9320-caccee8bd851 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:01.898875 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8499313b-ce2d-48d3-9165-8137738b378c tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:01.907338 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-85168620-fcbd-49f0-9320-caccee8bd851 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:01.907890 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8499313b-ce2d-48d3-9165-8137738b378c tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1508 microversion: 2.1 time: 0.166588 Sep 09 21:31:01.908799 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 282/549] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:01 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:01.920919 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-85168620-fcbd-49f0-9320-caccee8bd851 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.167591 Sep 09 21:31:01.921657 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 268/550] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:01 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:31:01.931082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bb29144e-2128-4c40-87a2-3cd3084f8ca6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66a9443e-f183-4d99-b98b-091967d7a8ed", "device": "/dev/sdb"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:31:01.933866 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bb29144e-2128-4c40-87a2-3cd3084f8ca6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:01.940093 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bb29144e-2128-4c40-87a2-3cd3084f8ca6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:01.940576 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bb29144e-2128-4c40-87a2-3cd3084f8ca6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:01.941013 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bb29144e-2128-4c40-87a2-3cd3084f8ca6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:01.941704 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bb29144e-2128-4c40-87a2-3cd3084f8ca6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:01.942159 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bb29144e-2128-4c40-87a2-3cd3084f8ca6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:01.942581 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bb29144e-2128-4c40-87a2-3cd3084f8ca6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:02.221185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bb29144e-2128-4c40-87a2-3cd3084f8ca6 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "POST /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294937 Sep 09 21:31:02.222075 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 283/551] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:31:01 2022] POST /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:31:02.946880 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-7ba5b00d-a8e1-4441-9f32-17d9f28c065b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:02.947496 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-7ba5b00d-a8e1-4441-9f32-17d9f28c065b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:02.954545 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ba5b00d-a8e1-4441-9f32-17d9f28c065b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:02.955048 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ba5b00d-a8e1-4441-9f32-17d9f28c065b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:02.955524 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ba5b00d-a8e1-4441-9f32-17d9f28c065b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:02.956306 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ba5b00d-a8e1-4441-9f32-17d9f28c065b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:02.956810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ba5b00d-a8e1-4441-9f32-17d9f28c065b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:02.957429 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ba5b00d-a8e1-4441-9f32-17d9f28c065b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:03.096779 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7ba5b00d-a8e1-4441-9f32-17d9f28c065b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:03.105551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-7ba5b00d-a8e1-4441-9f32-17d9f28c065b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.163888 Sep 09 21:31:03.107771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 269/552] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:02 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:04.133215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c74b17ba-37ee-4c7c-a32b-ac4fe42ba383 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:04.134053 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c74b17ba-37ee-4c7c-a32b-ac4fe42ba383 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:04.141181 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c74b17ba-37ee-4c7c-a32b-ac4fe42ba383 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:04.141671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c74b17ba-37ee-4c7c-a32b-ac4fe42ba383 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:04.142118 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c74b17ba-37ee-4c7c-a32b-ac4fe42ba383 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:04.142825 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c74b17ba-37ee-4c7c-a32b-ac4fe42ba383 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:04.143436 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c74b17ba-37ee-4c7c-a32b-ac4fe42ba383 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:04.143931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c74b17ba-37ee-4c7c-a32b-ac4fe42ba383 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:04.284891 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c74b17ba-37ee-4c7c-a32b-ac4fe42ba383 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:04.293826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c74b17ba-37ee-4c7c-a32b-ac4fe42ba383 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.167049 Sep 09 21:31:04.294392 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 284/553] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:04 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:05.317334 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8a8f0711-44bb-484e-b603-25ed74d1e04f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:05.317963 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8a8f0711-44bb-484e-b603-25ed74d1e04f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:05.324487 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8a8f0711-44bb-484e-b603-25ed74d1e04f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:05.324981 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8a8f0711-44bb-484e-b603-25ed74d1e04f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:05.325416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8a8f0711-44bb-484e-b603-25ed74d1e04f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:05.326112 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8a8f0711-44bb-484e-b603-25ed74d1e04f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:05.326573 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8a8f0711-44bb-484e-b603-25ed74d1e04f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:05.327000 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8a8f0711-44bb-484e-b603-25ed74d1e04f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:05.468888 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8a8f0711-44bb-484e-b603-25ed74d1e04f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:05.478874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8a8f0711-44bb-484e-b603-25ed74d1e04f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.165364 Sep 09 21:31:05.484274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 270/554] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:05 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:06.502087 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-83da47fe-df08-4b57-a87b-af44710fca22 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:06.502740 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-83da47fe-df08-4b57-a87b-af44710fca22 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:06.512981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83da47fe-df08-4b57-a87b-af44710fca22 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:06.513613 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83da47fe-df08-4b57-a87b-af44710fca22 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:06.514054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83da47fe-df08-4b57-a87b-af44710fca22 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:06.514870 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83da47fe-df08-4b57-a87b-af44710fca22 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:06.515189 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83da47fe-df08-4b57-a87b-af44710fca22 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:06.515659 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83da47fe-df08-4b57-a87b-af44710fca22 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:06.666579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-83da47fe-df08-4b57-a87b-af44710fca22 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:06.674725 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-83da47fe-df08-4b57-a87b-af44710fca22 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.176504 Sep 09 21:31:06.675473 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 285/555] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:06 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:07.698998 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2fe7e8af-32e4-47a1-acb8-4df92109492a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:07.699677 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2fe7e8af-32e4-47a1-acb8-4df92109492a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:07.706121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe7e8af-32e4-47a1-acb8-4df92109492a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:07.706608 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe7e8af-32e4-47a1-acb8-4df92109492a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:07.707047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe7e8af-32e4-47a1-acb8-4df92109492a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:07.707764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe7e8af-32e4-47a1-acb8-4df92109492a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:07.708227 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe7e8af-32e4-47a1-acb8-4df92109492a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:07.708662 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe7e8af-32e4-47a1-acb8-4df92109492a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:07.841216 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2fe7e8af-32e4-47a1-acb8-4df92109492a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:07.849396 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2fe7e8af-32e4-47a1-acb8-4df92109492a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.154971 Sep 09 21:31:07.849962 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 271/556] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:07 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:08.875675 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7607dff0-7ce0-4cfe-8e4d-06abac40ba98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:08.877041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7607dff0-7ce0-4cfe-8e4d-06abac40ba98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:08.885537 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7607dff0-7ce0-4cfe-8e4d-06abac40ba98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:08.886022 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7607dff0-7ce0-4cfe-8e4d-06abac40ba98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:08.886460 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7607dff0-7ce0-4cfe-8e4d-06abac40ba98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:08.887155 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7607dff0-7ce0-4cfe-8e4d-06abac40ba98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:08.887645 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7607dff0-7ce0-4cfe-8e4d-06abac40ba98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:08.888071 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7607dff0-7ce0-4cfe-8e4d-06abac40ba98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:09.023432 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7607dff0-7ce0-4cfe-8e4d-06abac40ba98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:09.031790 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7607dff0-7ce0-4cfe-8e4d-06abac40ba98 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.161949 Sep 09 21:31:09.032348 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 286/557] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:08 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:10.055037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f7aea2d2-a544-44fe-9ffb-14dd1f00b365 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:10.055699 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f7aea2d2-a544-44fe-9ffb-14dd1f00b365 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:10.062228 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f7aea2d2-a544-44fe-9ffb-14dd1f00b365 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:10.062717 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f7aea2d2-a544-44fe-9ffb-14dd1f00b365 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:10.063155 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f7aea2d2-a544-44fe-9ffb-14dd1f00b365 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:10.063872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f7aea2d2-a544-44fe-9ffb-14dd1f00b365 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:10.064334 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f7aea2d2-a544-44fe-9ffb-14dd1f00b365 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:10.064767 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f7aea2d2-a544-44fe-9ffb-14dd1f00b365 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:10.082857 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:10.418899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f7aea2d2-a544-44fe-9ffb-14dd1f00b365 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:10.428363 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f7aea2d2-a544-44fe-9ffb-14dd1f00b365 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.377273 Sep 09 21:31:10.428940 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 272/558] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:10 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:11.453474 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-eb8b543c-2c1b-47e0-abce-30b78125d8f0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:11.454083 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-eb8b543c-2c1b-47e0-abce-30b78125d8f0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:11.460795 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eb8b543c-2c1b-47e0-abce-30b78125d8f0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:11.461284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eb8b543c-2c1b-47e0-abce-30b78125d8f0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:11.461724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eb8b543c-2c1b-47e0-abce-30b78125d8f0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:11.462415 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eb8b543c-2c1b-47e0-abce-30b78125d8f0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:11.462870 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eb8b543c-2c1b-47e0-abce-30b78125d8f0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:11.463295 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eb8b543c-2c1b-47e0-abce-30b78125d8f0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:11.595185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-eb8b543c-2c1b-47e0-abce-30b78125d8f0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:11.604913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-eb8b543c-2c1b-47e0-abce-30b78125d8f0 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.155035 Sep 09 21:31:11.605712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 287/559] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:11 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:12.630536 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9e1e3f98-f4de-4a1a-b1aa-ca609238f85c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:12.631058 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9e1e3f98-f4de-4a1a-b1aa-ca609238f85c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:12.638409 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e1e3f98-f4de-4a1a-b1aa-ca609238f85c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:12.638895 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e1e3f98-f4de-4a1a-b1aa-ca609238f85c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:12.639323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e1e3f98-f4de-4a1a-b1aa-ca609238f85c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:12.640038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e1e3f98-f4de-4a1a-b1aa-ca609238f85c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:12.640495 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e1e3f98-f4de-4a1a-b1aa-ca609238f85c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:12.640916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e1e3f98-f4de-4a1a-b1aa-ca609238f85c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:12.768615 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-9e1e3f98-f4de-4a1a-b1aa-ca609238f85c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:12.776732 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9e1e3f98-f4de-4a1a-b1aa-ca609238f85c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.150131 Sep 09 21:31:12.777284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 273/560] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:12 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:13.800664 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5a7d8de3-96e8-40c9-bfc0-515d06ddc72d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:13.801277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5a7d8de3-96e8-40c9-bfc0-515d06ddc72d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:13.807896 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5a7d8de3-96e8-40c9-bfc0-515d06ddc72d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:13.808387 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5a7d8de3-96e8-40c9-bfc0-515d06ddc72d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:13.808821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5a7d8de3-96e8-40c9-bfc0-515d06ddc72d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:13.809540 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5a7d8de3-96e8-40c9-bfc0-515d06ddc72d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:13.809994 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5a7d8de3-96e8-40c9-bfc0-515d06ddc72d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:13.810421 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5a7d8de3-96e8-40c9-bfc0-515d06ddc72d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:13.828674 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:13.940057 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-5a7d8de3-96e8-40c9-bfc0-515d06ddc72d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:13.948829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5a7d8de3-96e8-40c9-bfc0-515d06ddc72d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.152018 Sep 09 21:31:13.949393 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 288/561] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:13 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:14.972120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9e6643d1-82d8-42f8-97d7-f8fe81bb7005 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:14.972739 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9e6643d1-82d8-42f8-97d7-f8fe81bb7005 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:14.979957 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e6643d1-82d8-42f8-97d7-f8fe81bb7005 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:14.980443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e6643d1-82d8-42f8-97d7-f8fe81bb7005 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:14.980879 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e6643d1-82d8-42f8-97d7-f8fe81bb7005 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:14.981568 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e6643d1-82d8-42f8-97d7-f8fe81bb7005 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:14.982026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e6643d1-82d8-42f8-97d7-f8fe81bb7005 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:14.982451 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e6643d1-82d8-42f8-97d7-f8fe81bb7005 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:15.114021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-9e6643d1-82d8-42f8-97d7-f8fe81bb7005 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:15.122558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9e6643d1-82d8-42f8-97d7-f8fe81bb7005 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.154315 Sep 09 21:31:15.123126 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 274/562] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:14 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:16.146030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f9335805-b891-4704-ad02-72ed29fe1d45 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:16.146640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f9335805-b891-4704-ad02-72ed29fe1d45 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:16.153671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9335805-b891-4704-ad02-72ed29fe1d45 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:16.154156 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9335805-b891-4704-ad02-72ed29fe1d45 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:16.154594 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9335805-b891-4704-ad02-72ed29fe1d45 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:16.155279 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9335805-b891-4704-ad02-72ed29fe1d45 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:16.155761 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9335805-b891-4704-ad02-72ed29fe1d45 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:16.156202 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f9335805-b891-4704-ad02-72ed29fe1d45 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:16.284463 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f9335805-b891-4704-ad02-72ed29fe1d45 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:16.293260 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f9335805-b891-4704-ad02-72ed29fe1d45 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1735 microversion: 2.1 time: 0.151073 Sep 09 21:31:16.293824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 289/563] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:16 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:17.315374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-606b9beb-3141-402f-9a73-1f1f6dec9848 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:17.316100 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-606b9beb-3141-402f-9a73-1f1f6dec9848 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:17.323318 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-606b9beb-3141-402f-9a73-1f1f6dec9848 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:17.323839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-606b9beb-3141-402f-9a73-1f1f6dec9848 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:17.324278 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-606b9beb-3141-402f-9a73-1f1f6dec9848 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:17.324961 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-606b9beb-3141-402f-9a73-1f1f6dec9848 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:17.325415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-606b9beb-3141-402f-9a73-1f1f6dec9848 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:17.325837 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-606b9beb-3141-402f-9a73-1f1f6dec9848 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:17.451510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-606b9beb-3141-402f-9a73-1f1f6dec9848 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:17.459440 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-606b9beb-3141-402f-9a73-1f1f6dec9848 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1715 microversion: 2.1 time: 0.147913 Sep 09 21:31:17.460043 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 275/564] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:17 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:17.567892 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:17.568388 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:17.575824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:17.576310 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:17.576747 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:17.577429 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:17.577885 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:17.578308 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:17.707026 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] HTTP exception thrown: Cannot 'detach_volume' instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 while it is in vm_state rescued Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Request method failure captured: Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: DELETE /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments/549d0545-6dfe-4767-aab7-0c3ca11939bb HTTP/1.1 Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG6-hYeoA0KilbcouWpERZ9YtQ82F_IJMypUZNsqF-LHQO0jXBghrw_akyfPTZ9RfD5QZsUC56WPkMWHPye2TMrxCBvzQNtqia3kTLk6srJ6joD45wfLdTCle-w3LQa2RNfPLhaz2Ly1gmO4Nr9NiDeNh0DEz2qj6shMAQnL2Zfug0yo Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 5472cdfe59524ac5b826fba54758c68f Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:31:17.708657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5472cdfe59524ac5b826fba54758c68f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5472cdfe59524ac5b826fba54758c68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5472cdfe59524ac5b826fba54758c68f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5472cdfe59524ac5b826fba54758c68f"}]}] Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 5472cdfe59524ac5b826fba54758c68f Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-ServerRescueNegativeTestJSON-1311387682-project Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 0d773c7f6aca4ea2ad2872f67e9116af Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311387682-project Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:31:17.710326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Cannot 'detach_volume' instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 while it is in vm_state rescued Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'server_id': '99bb0cf9-68da-449d-bdbd-d8c1aa49dc96', 'id': '549d0545-6dfe-4767-aab7-0c3ca11939bb'} Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:31:17.711459 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 while it is in vm_state rescued Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 while it is in vm_state rescued Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:31:17.712778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Returning 409 to user: Cannot 'detach_volume' instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 while it is in vm_state rescued {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:31:17.713860 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-21c1d1a2-5104-4932-a762-000622a2db73 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "DELETE /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments/549d0545-6dfe-4767-aab7-0c3ca11939bb" status: 409 len: 152 microversion: 2.1 time: 0.146123 Sep 09 21:31:17.713860 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 290/565] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:31:17 2022] DELETE /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments/549d0545-6dfe-4767-aab7-0c3ca11939bb => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 21:31:17.719068 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-850e58f2-f811-423c-b7b1-57aa915c1766 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:31:17.719634 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-850e58f2-f811-423c-b7b1-57aa915c1766 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:17.725532 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-850e58f2-f811-423c-b7b1-57aa915c1766 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:17.726034 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-850e58f2-f811-423c-b7b1-57aa915c1766 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:17.726566 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-850e58f2-f811-423c-b7b1-57aa915c1766 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:17.727267 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-850e58f2-f811-423c-b7b1-57aa915c1766 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:17.727758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-850e58f2-f811-423c-b7b1-57aa915c1766 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:17.728190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-850e58f2-f811-423c-b7b1-57aa915c1766 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:17.793215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-850e58f2-f811-423c-b7b1-57aa915c1766 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "POST /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/action" status: 202 len: 0 microversion: 2.1 time: 0.077562 Sep 09 21:31:17.794010 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 276/566] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:31:17 2022] POST /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:31:17.802035 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5ff47f4a-26b9-45cc-be63-7a7e288ec1f7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:17.802647 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5ff47f4a-26b9-45cc-be63-7a7e288ec1f7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:17.809668 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5ff47f4a-26b9-45cc-be63-7a7e288ec1f7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:17.810171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5ff47f4a-26b9-45cc-be63-7a7e288ec1f7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:17.810633 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5ff47f4a-26b9-45cc-be63-7a7e288ec1f7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:17.811335 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5ff47f4a-26b9-45cc-be63-7a7e288ec1f7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:17.811910 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5ff47f4a-26b9-45cc-be63-7a7e288ec1f7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:17.812346 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5ff47f4a-26b9-45cc-be63-7a7e288ec1f7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:18.029999 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-5ff47f4a-26b9-45cc-be63-7a7e288ec1f7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:18.039167 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5ff47f4a-26b9-45cc-be63-7a7e288ec1f7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1723 microversion: 2.1 time: 0.240409 Sep 09 21:31:18.051621 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 291/567] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:17 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:19.063208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-55b749f5-712b-41ed-ad85-40fad5e4282f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:19.063932 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-55b749f5-712b-41ed-ad85-40fad5e4282f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:19.071044 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55b749f5-712b-41ed-ad85-40fad5e4282f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:19.071553 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55b749f5-712b-41ed-ad85-40fad5e4282f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:19.072004 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55b749f5-712b-41ed-ad85-40fad5e4282f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:19.072695 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55b749f5-712b-41ed-ad85-40fad5e4282f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:19.073162 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55b749f5-712b-41ed-ad85-40fad5e4282f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:19.073595 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-55b749f5-712b-41ed-ad85-40fad5e4282f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:19.206304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-55b749f5-712b-41ed-ad85-40fad5e4282f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:19.214594 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-55b749f5-712b-41ed-ad85-40fad5e4282f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1723 microversion: 2.1 time: 0.155535 Sep 09 21:31:19.215146 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 277/568] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:19 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:20.236779 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5e302bd4-eeff-4e34-9b4f-836085971b99 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:20.237387 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5e302bd4-eeff-4e34-9b4f-836085971b99 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:20.244373 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e302bd4-eeff-4e34-9b4f-836085971b99 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:20.244786 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e302bd4-eeff-4e34-9b4f-836085971b99 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:20.245216 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e302bd4-eeff-4e34-9b4f-836085971b99 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:20.245891 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e302bd4-eeff-4e34-9b4f-836085971b99 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:20.246341 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e302bd4-eeff-4e34-9b4f-836085971b99 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:20.246759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e302bd4-eeff-4e34-9b4f-836085971b99 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:20.374829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-5e302bd4-eeff-4e34-9b4f-836085971b99 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:20.383355 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5e302bd4-eeff-4e34-9b4f-836085971b99 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1723 microversion: 2.1 time: 0.149855 Sep 09 21:31:20.383945 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 292/569] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:20 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:21.407807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4d259499-2bba-4c15-acc4-36ac5862ac63 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:21.408441 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4d259499-2bba-4c15-acc4-36ac5862ac63 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:21.415211 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d259499-2bba-4c15-acc4-36ac5862ac63 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:21.415740 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d259499-2bba-4c15-acc4-36ac5862ac63 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:21.416177 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d259499-2bba-4c15-acc4-36ac5862ac63 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:21.416855 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d259499-2bba-4c15-acc4-36ac5862ac63 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:21.417307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d259499-2bba-4c15-acc4-36ac5862ac63 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:21.417734 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4d259499-2bba-4c15-acc4-36ac5862ac63 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:21.552052 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4d259499-2bba-4c15-acc4-36ac5862ac63 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:21.560397 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4d259499-2bba-4c15-acc4-36ac5862ac63 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1723 microversion: 2.1 time: 0.156870 Sep 09 21:31:21.560952 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 278/570] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:21 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:22.583582 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2b9043e9-39dc-4a9d-9e45-f06f85225d14 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:22.584197 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2b9043e9-39dc-4a9d-9e45-f06f85225d14 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:22.590881 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b9043e9-39dc-4a9d-9e45-f06f85225d14 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:22.591367 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b9043e9-39dc-4a9d-9e45-f06f85225d14 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:22.591842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b9043e9-39dc-4a9d-9e45-f06f85225d14 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:22.592529 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b9043e9-39dc-4a9d-9e45-f06f85225d14 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:22.592986 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b9043e9-39dc-4a9d-9e45-f06f85225d14 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:22.593409 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b9043e9-39dc-4a9d-9e45-f06f85225d14 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:22.730480 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2b9043e9-39dc-4a9d-9e45-f06f85225d14 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:22.738488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2b9043e9-39dc-4a9d-9e45-f06f85225d14 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1723 microversion: 2.1 time: 0.158739 Sep 09 21:31:22.739037 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 293/571] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:22 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:23.763167 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-95edaf73-6487-4238-b282-6ab3fe890a3b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:23.763729 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-95edaf73-6487-4238-b282-6ab3fe890a3b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:23.770065 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95edaf73-6487-4238-b282-6ab3fe890a3b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:23.770543 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95edaf73-6487-4238-b282-6ab3fe890a3b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:23.770980 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95edaf73-6487-4238-b282-6ab3fe890a3b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:23.771679 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95edaf73-6487-4238-b282-6ab3fe890a3b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:23.772132 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95edaf73-6487-4238-b282-6ab3fe890a3b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:23.772553 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-95edaf73-6487-4238-b282-6ab3fe890a3b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:23.904901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-95edaf73-6487-4238-b282-6ab3fe890a3b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:23.913224 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-95edaf73-6487-4238-b282-6ab3fe890a3b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1723 microversion: 2.1 time: 0.154899 Sep 09 21:31:23.913781 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 279/572] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:23 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:24.936014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5dd51766-25b1-4c6e-8d19-30a020e7e71a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:24.936601 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5dd51766-25b1-4c6e-8d19-30a020e7e71a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:24.942932 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5dd51766-25b1-4c6e-8d19-30a020e7e71a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:24.943412 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5dd51766-25b1-4c6e-8d19-30a020e7e71a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:24.943876 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5dd51766-25b1-4c6e-8d19-30a020e7e71a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:24.944556 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5dd51766-25b1-4c6e-8d19-30a020e7e71a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:24.945009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5dd51766-25b1-4c6e-8d19-30a020e7e71a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:24.946144 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5dd51766-25b1-4c6e-8d19-30a020e7e71a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:25.074050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-5dd51766-25b1-4c6e-8d19-30a020e7e71a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:25.082287 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5dd51766-25b1-4c6e-8d19-30a020e7e71a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1723 microversion: 2.1 time: 0.150146 Sep 09 21:31:25.082846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 294/573] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:24 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:26.108048 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-167d7a9c-10a1-402b-9ae9-56dde6cfa5cb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:26.108682 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-167d7a9c-10a1-402b-9ae9-56dde6cfa5cb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:26.115010 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-167d7a9c-10a1-402b-9ae9-56dde6cfa5cb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:26.115488 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-167d7a9c-10a1-402b-9ae9-56dde6cfa5cb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:26.115952 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-167d7a9c-10a1-402b-9ae9-56dde6cfa5cb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:26.116636 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-167d7a9c-10a1-402b-9ae9-56dde6cfa5cb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:26.117710 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-167d7a9c-10a1-402b-9ae9-56dde6cfa5cb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:26.118380 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-167d7a9c-10a1-402b-9ae9-56dde6cfa5cb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:26.248797 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-167d7a9c-10a1-402b-9ae9-56dde6cfa5cb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:26.256852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-167d7a9c-10a1-402b-9ae9-56dde6cfa5cb tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1723 microversion: 2.1 time: 0.152703 Sep 09 21:31:26.257407 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 280/574] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:26 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:27.280446 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9f311a3a-e457-482a-9f0e-13ea1056dd46 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:27.281081 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9f311a3a-e457-482a-9f0e-13ea1056dd46 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:27.287989 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f311a3a-e457-482a-9f0e-13ea1056dd46 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:27.288505 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f311a3a-e457-482a-9f0e-13ea1056dd46 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:27.289078 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f311a3a-e457-482a-9f0e-13ea1056dd46 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:27.289764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f311a3a-e457-482a-9f0e-13ea1056dd46 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:27.290217 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f311a3a-e457-482a-9f0e-13ea1056dd46 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:27.290642 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9f311a3a-e457-482a-9f0e-13ea1056dd46 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:27.431845 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9f311a3a-e457-482a-9f0e-13ea1056dd46 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:27.440387 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9f311a3a-e457-482a-9f0e-13ea1056dd46 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1729 microversion: 2.1 time: 0.163770 Sep 09 21:31:27.440951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 295/575] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:27 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:27.463943 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3e1118ff-8507-4e48-ac93-66dc9d2220ca tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:27.464447 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3e1118ff-8507-4e48-ac93-66dc9d2220ca tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:27.466876 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=36 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:27.471934 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e1118ff-8507-4e48-ac93-66dc9d2220ca tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:27.472588 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e1118ff-8507-4e48-ac93-66dc9d2220ca tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:27.473024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e1118ff-8507-4e48-ac93-66dc9d2220ca tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:27.473714 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e1118ff-8507-4e48-ac93-66dc9d2220ca tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:27.474169 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e1118ff-8507-4e48-ac93-66dc9d2220ca tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:27.474591 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e1118ff-8507-4e48-ac93-66dc9d2220ca tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:27.553713 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3e1118ff-8507-4e48-ac93-66dc9d2220ca tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094130 Sep 09 21:31:27.554902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 281/576] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 21:31:27 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:31:27.876748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6864e4af-a17c-4829-ac7f-71a263d161a3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:27.877234 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6864e4af-a17c-4829-ac7f-71a263d161a3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:27.883106 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6864e4af-a17c-4829-ac7f-71a263d161a3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:27.883736 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6864e4af-a17c-4829-ac7f-71a263d161a3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:27.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6864e4af-a17c-4829-ac7f-71a263d161a3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:27.884858 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6864e4af-a17c-4829-ac7f-71a263d161a3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:27.885307 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6864e4af-a17c-4829-ac7f-71a263d161a3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:27.885725 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6864e4af-a17c-4829-ac7f-71a263d161a3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:27.967757 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-6864e4af-a17c-4829-ac7f-71a263d161a3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lazy-loading 'services' on Instance uuid f7966f60-922a-45dd-a30f-104e10d5696c {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:31:28.083563 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6864e4af-a17c-4829-ac7f-71a263d161a3 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c/os-volume_attachments/66a9443e-f183-4d99-b98b-091967d7a8ed" status: 202 len: 0 microversion: 2.1 time: 0.210231 Sep 09 21:31:28.084239 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 296/577] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:31:27 2022] DELETE /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c/os-volume_attachments/66a9443e-f183-4d99-b98b-091967d7a8ed => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:31:28.523855 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-b8fd39b1-0439-4bd3-88a7-365630cd7acc req-b0a86d8f-c1bf-46d1-ad2e-9df81ea9c1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bb0cf9-68da-449d-bdbd-d8c1aa49dc96", "tag": "9163f46b-8a4c-44b4-a67e-f7a360441df7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:31:28.533661 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8fd39b1-0439-4bd3-88a7-365630cd7acc req-b0a86d8f-c1bf-46d1-ad2e-9df81ea9c1b3 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:28.534231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8fd39b1-0439-4bd3-88a7-365630cd7acc req-b0a86d8f-c1bf-46d1-ad2e-9df81ea9c1b3 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:28.534733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b8fd39b1-0439-4bd3-88a7-365630cd7acc req-b0a86d8f-c1bf-46d1-ad2e-9df81ea9c1b3 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:28.546628 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-b8fd39b1-0439-4bd3-88a7-365630cd7acc req-b0a86d8f-c1bf-46d1-ad2e-9df81ea9c1b3 service nova] Creating event network-changed:9163f46b-8a4c-44b4-a67e-f7a360441df7 for instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 on hv-cinder-85221 Sep 09 21:31:28.551760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-b8fd39b1-0439-4bd3-88a7-365630cd7acc req-b0a86d8f-c1bf-46d1-ad2e-9df81ea9c1b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088007 Sep 09 21:31:28.552351 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 282/578] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:31:30.300490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7eb7256c-bb3f-4158-a65b-378ce2e5d461 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:30.301069 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7eb7256c-bb3f-4158-a65b-378ce2e5d461 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:30.303591 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=34 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:30.309270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7eb7256c-bb3f-4158-a65b-378ce2e5d461 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:30.309760 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7eb7256c-bb3f-4158-a65b-378ce2e5d461 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:30.310203 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7eb7256c-bb3f-4158-a65b-378ce2e5d461 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:30.310897 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7eb7256c-bb3f-4158-a65b-378ce2e5d461 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:30.311358 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7eb7256c-bb3f-4158-a65b-378ce2e5d461 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:30.311824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7eb7256c-bb3f-4158-a65b-378ce2e5d461 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:30.336064 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7eb7256c-bb3f-4158-a65b-378ce2e5d461 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:31:30.416762 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7eb7256c-bb3f-4158-a65b-378ce2e5d461 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 204 len: 0 microversion: 2.1 time: 0.120226 Sep 09 21:31:30.417425 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 297/579] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:31:30 2022] DELETE /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:31:30.426593 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-62255bab-16d7-41b2-b21a-3af59120ba22 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:30.427320 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-62255bab-16d7-41b2-b21a-3af59120ba22 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:30.434266 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-62255bab-16d7-41b2-b21a-3af59120ba22 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:30.434752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-62255bab-16d7-41b2-b21a-3af59120ba22 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:30.435212 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-62255bab-16d7-41b2-b21a-3af59120ba22 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:30.435991 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-62255bab-16d7-41b2-b21a-3af59120ba22 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:30.436447 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-62255bab-16d7-41b2-b21a-3af59120ba22 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:30.436866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-62255bab-16d7-41b2-b21a-3af59120ba22 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:30.573615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-776aa882-bd5e-4c44-8c36-99e12f50c210 req-d7c1aa4a-0fc5-4624-8363-d417763cb475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bb0cf9-68da-449d-bdbd-d8c1aa49dc96", "tag": "9163f46b-8a4c-44b4-a67e-f7a360441df7"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:31:30.574734 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-62255bab-16d7-41b2-b21a-3af59120ba22 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:30.582428 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-62255bab-16d7-41b2-b21a-3af59120ba22 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1514 microversion: 2.1 time: 0.160566 Sep 09 21:31:30.582946 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-776aa882-bd5e-4c44-8c36-99e12f50c210 req-d7c1aa4a-0fc5-4624-8363-d417763cb475 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:30.583113 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 283/580] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:30 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:30.583414 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-776aa882-bd5e-4c44-8c36-99e12f50c210 req-d7c1aa4a-0fc5-4624-8363-d417763cb475 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:30.583868 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-776aa882-bd5e-4c44-8c36-99e12f50c210 req-d7c1aa4a-0fc5-4624-8363-d417763cb475 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:30.594426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-776aa882-bd5e-4c44-8c36-99e12f50c210 req-d7c1aa4a-0fc5-4624-8363-d417763cb475 service nova] Creating event network-changed:9163f46b-8a4c-44b4-a67e-f7a360441df7 for instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 on hv-cinder-85221 Sep 09 21:31:30.599365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-776aa882-bd5e-4c44-8c36-99e12f50c210 req-d7c1aa4a-0fc5-4624-8363-d417763cb475 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030594 Sep 09 21:31:30.600007 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 298/581] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:31:31.605720 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1b6aff90-3fed-4529-a1b4-dcdad90f014f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:31.606325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1b6aff90-3fed-4529-a1b4-dcdad90f014f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:31.612805 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b6aff90-3fed-4529-a1b4-dcdad90f014f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:31.613353 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b6aff90-3fed-4529-a1b4-dcdad90f014f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:31.613715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b6aff90-3fed-4529-a1b4-dcdad90f014f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:31.614394 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b6aff90-3fed-4529-a1b4-dcdad90f014f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:31.614841 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b6aff90-3fed-4529-a1b4-dcdad90f014f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:31.615261 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1b6aff90-3fed-4529-a1b4-dcdad90f014f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:31.754509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1b6aff90-3fed-4529-a1b4-dcdad90f014f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:31.763074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1b6aff90-3fed-4529-a1b4-dcdad90f014f tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1514 microversion: 2.1 time: 0.161743 Sep 09 21:31:31.763848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 284/582] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:31 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:31.781201 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f3cca441-30b5-460b-9943-e1d5e460a814 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:31.781831 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f3cca441-30b5-460b-9943-e1d5e460a814 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:31.788250 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3cca441-30b5-460b-9943-e1d5e460a814 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:31.788733 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3cca441-30b5-460b-9943-e1d5e460a814 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:31.789167 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3cca441-30b5-460b-9943-e1d5e460a814 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:31.789911 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3cca441-30b5-460b-9943-e1d5e460a814 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:31.790365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3cca441-30b5-460b-9943-e1d5e460a814 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:31.790793 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3cca441-30b5-460b-9943-e1d5e460a814 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:31.819370 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f3cca441-30b5-460b-9943-e1d5e460a814 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments/a0816021-bc56-44cc-aafc-4a35db853293" status: 200 len: 194 microversion: 2.20 time: 0.151784 Sep 09 21:31:31.819962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 299/583] 10.222.0.46 () {60 vars in 1454 bytes} [Fri Sep 9 21:31:31 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments/a0816021-bc56-44cc-aafc-4a35db853293 => generated 194 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 21:31:31.892575 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0b5d2123-0264-4e3f-bbdb-b1cd9838d3da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:31.893075 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0b5d2123-0264-4e3f-bbdb-b1cd9838d3da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:31.898974 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b5d2123-0264-4e3f-bbdb-b1cd9838d3da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:31.900105 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b5d2123-0264-4e3f-bbdb-b1cd9838d3da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:31.900585 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b5d2123-0264-4e3f-bbdb-b1cd9838d3da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:31.901290 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b5d2123-0264-4e3f-bbdb-b1cd9838d3da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:31.901752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b5d2123-0264-4e3f-bbdb-b1cd9838d3da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:31.902184 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b5d2123-0264-4e3f-bbdb-b1cd9838d3da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:31.982329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-0b5d2123-0264-4e3f-bbdb-b1cd9838d3da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lazy-loading 'services' on Instance uuid cb8f74a7-256c-4810-944b-e4f66773aa13 {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:31:32.053859 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0b5d2123-0264-4e3f-bbdb-b1cd9838d3da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments/a0816021-bc56-44cc-aafc-4a35db853293" status: 202 len: 0 microversion: 2.20 time: 0.165044 Sep 09 21:31:32.054659 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 285/584] 10.222.0.46 () {60 vars in 1457 bytes} [Fri Sep 9 21:31:31 2022] DELETE /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments/a0816021-bc56-44cc-aafc-4a35db853293 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:31:32.063632 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8dae1e28-ad44-4a4f-8c1e-5aa4bd6d33e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:32.065941 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8dae1e28-ad44-4a4f-8c1e-5aa4bd6d33e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:32.073241 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8dae1e28-ad44-4a4f-8c1e-5aa4bd6d33e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:32.073805 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8dae1e28-ad44-4a4f-8c1e-5aa4bd6d33e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:32.074258 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8dae1e28-ad44-4a4f-8c1e-5aa4bd6d33e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:32.075141 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8dae1e28-ad44-4a4f-8c1e-5aa4bd6d33e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:32.075794 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8dae1e28-ad44-4a4f-8c1e-5aa4bd6d33e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:32.076365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8dae1e28-ad44-4a4f-8c1e-5aa4bd6d33e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:32.111069 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8dae1e28-ad44-4a4f-8c1e-5aa4bd6d33e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051925 Sep 09 21:31:32.111643 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 300/585] 10.222.0.46 () {60 vars in 1343 bytes} [Fri Sep 9 21:31:32 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:31:32.788735 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9bf56b7a-8bc8-4acb-8cf1-82015dc0245e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:32.789427 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9bf56b7a-8bc8-4acb-8cf1-82015dc0245e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:32.795825 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf56b7a-8bc8-4acb-8cf1-82015dc0245e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:32.796305 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf56b7a-8bc8-4acb-8cf1-82015dc0245e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:32.796732 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf56b7a-8bc8-4acb-8cf1-82015dc0245e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:32.797405 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf56b7a-8bc8-4acb-8cf1-82015dc0245e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:32.797862 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf56b7a-8bc8-4acb-8cf1-82015dc0245e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:32.798281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9bf56b7a-8bc8-4acb-8cf1-82015dc0245e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:32.928696 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-9bf56b7a-8bc8-4acb-8cf1-82015dc0245e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:32.937106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9bf56b7a-8bc8-4acb-8cf1-82015dc0245e tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1514 microversion: 2.1 time: 0.153182 Sep 09 21:31:32.937675 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 286/586] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:32 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:33.124775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-88c20e12-1aa5-4ea0-837f-e4d686ac461e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:33.127554 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-88c20e12-1aa5-4ea0-837f-e4d686ac461e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:33.134819 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-88c20e12-1aa5-4ea0-837f-e4d686ac461e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:33.135614 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-88c20e12-1aa5-4ea0-837f-e4d686ac461e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:33.136300 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-88c20e12-1aa5-4ea0-837f-e4d686ac461e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:33.137228 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-88c20e12-1aa5-4ea0-837f-e4d686ac461e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:33.137909 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-88c20e12-1aa5-4ea0-837f-e4d686ac461e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:33.138571 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-88c20e12-1aa5-4ea0-837f-e4d686ac461e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:33.174284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-88c20e12-1aa5-4ea0-837f-e4d686ac461e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054117 Sep 09 21:31:33.175484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 301/587] 10.222.0.46 () {60 vars in 1343 bytes} [Fri Sep 9 21:31:33 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:31:33.485971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-06a353cf-0f7c-4e9e-86c9-80726e05b60b req-d099037c-66d7-404b-819d-c6510849c54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7966f60-922a-45dd-a30f-104e10d5696c", "name": "network-vif-deleted", "tag": "7c773c2d-d9aa-442a-9554-21bc8f82ff6b"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:31:33.496848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-06a353cf-0f7c-4e9e-86c9-80726e05b60b req-d099037c-66d7-404b-819d-c6510849c54c service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:33.497330 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-06a353cf-0f7c-4e9e-86c9-80726e05b60b req-d099037c-66d7-404b-819d-c6510849c54c service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:33.497762 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-06a353cf-0f7c-4e9e-86c9-80726e05b60b req-d099037c-66d7-404b-819d-c6510849c54c service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:33.509737 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-06a353cf-0f7c-4e9e-86c9-80726e05b60b req-d099037c-66d7-404b-819d-c6510849c54c service nova] Creating event network-vif-deleted:7c773c2d-d9aa-442a-9554-21bc8f82ff6b for instance f7966f60-922a-45dd-a30f-104e10d5696c on hv-cinder-85221 Sep 09 21:31:33.515392 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-06a353cf-0f7c-4e9e-86c9-80726e05b60b req-d099037c-66d7-404b-819d-c6510849c54c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Sep 09 21:31:33.516022 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 287/588] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:31:33.962495 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:33.963030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:33.968996 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:33.969483 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:33.969920 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:33.970605 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:33.971065 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:33.971490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:34.000596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:34.001074 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:34.001512 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:34.001957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lazy-loading 'fault' on Instance uuid f7966f60-922a-45dd-a30f-104e10d5696c {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:31:34.043638 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f32e144d6a4957b8c65befbce1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5effc588a44c458bd5bab9b1448b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:34.051199 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2b316f90-9962-4550-ae25-46c7b2fb6917 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 200 len: 1308 microversion: 2.1 time: 0.093232 Sep 09 21:31:34.051802 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 302/589] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:33 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:34.188703 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1cd15600-c432-4c90-98e7-9154005e81d6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:34.191198 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1cd15600-c432-4c90-98e7-9154005e81d6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:34.198569 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1cd15600-c432-4c90-98e7-9154005e81d6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:34.199060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1cd15600-c432-4c90-98e7-9154005e81d6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:34.199496 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1cd15600-c432-4c90-98e7-9154005e81d6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:34.200221 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1cd15600-c432-4c90-98e7-9154005e81d6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:34.200679 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1cd15600-c432-4c90-98e7-9154005e81d6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:34.201148 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1cd15600-c432-4c90-98e7-9154005e81d6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:34.232559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1cd15600-c432-4c90-98e7-9154005e81d6 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048179 Sep 09 21:31:34.233379 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 288/590] 10.222.0.46 () {60 vars in 1343 bytes} [Fri Sep 9 21:31:34 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:31:34.297918 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-537b6f2b-870c-449a-9a63-e89551e6acf4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:34.298403 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-537b6f2b-870c-449a-9a63-e89551e6acf4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:34.304927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-537b6f2b-870c-449a-9a63-e89551e6acf4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:34.305572 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-537b6f2b-870c-449a-9a63-e89551e6acf4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:34.306018 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-537b6f2b-870c-449a-9a63-e89551e6acf4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:34.306706 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-537b6f2b-870c-449a-9a63-e89551e6acf4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:34.307170 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-537b6f2b-870c-449a-9a63-e89551e6acf4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:34.307632 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-537b6f2b-870c-449a-9a63-e89551e6acf4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:34.311595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:34.333447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-537b6f2b-870c-449a-9a63-e89551e6acf4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:31:34.405612 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-537b6f2b-870c-449a-9a63-e89551e6acf4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 204 len: 0 microversion: 2.20 time: 0.111335 Sep 09 21:31:34.406381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 303/591] 10.222.0.46 () {60 vars in 1280 bytes} [Fri Sep 9 21:31:34 2022] DELETE /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 21:31:34.415471 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:34.416137 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:34.421997 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:34.422501 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:34.422925 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:34.423638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:34.424100 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:34.424529 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:34.428528 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:34.557739 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:34.565769 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:34.567229 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:34.568417 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a5dee7a7-a109-407a-b8be-a62c461839ba tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.157564 Sep 09 21:31:34.568969 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 289/592] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:34 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:35.075595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:35.076320 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] [instance: f7966f60-922a-45dd-a30f-104e10d5696c] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:35.082327 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:35.082803 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:35.083236 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:35.083946 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:35.084405 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:35.084820 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:35.098359 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] HTTP exception thrown: Instance f7966f60-922a-45dd-a30f-104e10d5696c could not be found. Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Request method failure captured: Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c HTTP/1.1 Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7AtTNPdQhMRBtRxJepI0HnEZN4UHUZb7B2gXXxtpCQA0EMKrxk0gA6pxi2McYPFeeC0dJJm3j-pDVgWgWHq5iGtKT84hyLM5Z4pC3ZblhWzH8jtnTBiSpI5gckDLQX9BiSOypNZ26-W8wMeBi7Mqy_GGuINFcUkNv4ETVV-q_tIUkc Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: cb5effc588a44c458bd5bab9b1448b87 Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1678656830 Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:31:35.100023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cb5effc588a44c458bd5bab9b1448b87", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb5effc588a44c458bd5bab9b1448b87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb5effc588a44c458bd5bab9b1448b87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cb5effc588a44c458bd5bab9b1448b87"}]}] Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-VolumesSnapshotTestJSON-1678656830 Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: cb5effc588a44c458bd5bab9b1448b87 Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1678656830 Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-VolumesSnapshotTestJSON-1678656830-project Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 04f32e144d6a4957b8c65befbce1f75a Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-VolumesSnapshotTestJSON-1678656830-project Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance f7966f60-922a-45dd-a30f-104e10d5696c could not be found. Sep 09 21:31:35.101631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': 'f7966f60-922a-45dd-a30f-104e10d5696c'} Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7966f60-922a-45dd-a30f-104e10d5696c could not be found. Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:31:35.102676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7966f60-922a-45dd-a30f-104e10d5696c could not be found. Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7966f60-922a-45dd-a30f-104e10d5696c could not be found. Sep 09 21:31:35.104059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:31:35.105139 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] Returning 404 to user: Instance f7966f60-922a-45dd-a30f-104e10d5696c could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:31:35.105139 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e64b68a1-8aad-4206-b499-4c7a8a1a4a79 tempest-VolumesSnapshotTestJSON-1678656830 tempest-VolumesSnapshotTestJSON-1678656830-project] 10.222.0.46 "GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c" status: 404 len: 111 microversion: 2.1 time: 0.030718 Sep 09 21:31:35.105139 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 304/593] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:31:35 2022] GET /compute/v2.1/servers/f7966f60-922a-45dd-a30f-104e10d5696c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:31:35.594281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:35.594831 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:35.601125 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:35.601599 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:35.602036 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:35.603358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:35.603832 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:35.604252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:35.730794 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:35.738705 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:35.740165 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:35.741312 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e79199c7-452e-4d97-a013-70d5aa4a8170 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.151061 Sep 09 21:31:35.741854 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 290/594] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:35 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:36.774984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:36.775864 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:36.782461 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:36.782944 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:36.783375 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:36.784092 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:36.784544 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:36.784965 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:36.921132 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:36.929183 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:36.931275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:36.932454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e9b8965b-8758-4582-b0d4-f48687b0cef3 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1725 microversion: 2.20 time: 0.162288 Sep 09 21:31:36.932999 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 305/595] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:36 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:37.453898 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-4ea682ae-75ab-45ee-92c6-bea643c4cbb1 req-1af5561f-cddd-4406-8b1f-17b95d0d641f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8f74a7-256c-4810-944b-e4f66773aa13", "name": "network-vif-deleted", "tag": "b28ee03c-d6a8-454c-b9c8-a9a10b589dbc"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:31:37.465384 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-4ea682ae-75ab-45ee-92c6-bea643c4cbb1 req-1af5561f-cddd-4406-8b1f-17b95d0d641f service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:37.465868 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-4ea682ae-75ab-45ee-92c6-bea643c4cbb1 req-1af5561f-cddd-4406-8b1f-17b95d0d641f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:37.466293 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-4ea682ae-75ab-45ee-92c6-bea643c4cbb1 req-1af5561f-cddd-4406-8b1f-17b95d0d641f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:37.477413 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-4ea682ae-75ab-45ee-92c6-bea643c4cbb1 req-1af5561f-cddd-4406-8b1f-17b95d0d641f service nova] Creating event network-vif-deleted:b28ee03c-d6a8-454c-b9c8-a9a10b589dbc for instance cb8f74a7-256c-4810-944b-e4f66773aa13 on hv-cinder-85221 Sep 09 21:31:37.482214 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-4ea682ae-75ab-45ee-92c6-bea643c4cbb1 req-1af5561f-cddd-4406-8b1f-17b95d0d641f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031984 Sep 09 21:31:37.482803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 291/596] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:31:37.957290 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:37.958233 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:37.966841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:37.968169 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:37.968716 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:37.969491 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:37.970020 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:37.970680 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:38.034474 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:38.042832 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:38.044449 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:38.045684 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6444e771-a6fd-46a3-a3f1-0f695a636da0 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1657 microversion: 2.20 time: 0.092663 Sep 09 21:31:38.060832 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 306/597] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:37 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1657 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:39.073743 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:39.074573 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:39.082806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:39.082806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:39.083182 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:39.084103 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:39.084628 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:39.085140 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:39.149103 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:39.157394 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:39.158813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:39.159995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-7a815ce7-b775-4da4-9c32-a083d66f162d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1367 microversion: 2.20 time: 0.091510 Sep 09 21:31:39.160538 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 292/598] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:39 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:40.185439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:40.186120 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:40.192431 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:40.192915 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:40.193345 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:40.194025 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:40.194475 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:40.194897 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:40.259008 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:40.266883 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:40.268321 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:40.269431 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b938e173-f434-40b1-a1be-cd5ec5e913aa tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 200 len: 1367 microversion: 2.20 time: 0.087885 Sep 09 21:31:40.269970 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 307/599] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:40 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:41.294084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:41.294664 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:41.301115 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:41.301611 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:41.302029 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:41.302705 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:41.303200 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:41.303659 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:41.316554 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] HTTP exception thrown: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Request method failure captured: Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 HTTP/1.1 Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG69DEBaOH-ADhfDFLp0KwqSisXNdgpiiCcdfB4pvSWzDezyPN5xBtrf0MT9eOsBxzaHUlTQX1byBm0-QhHNQdInL9M3jiwAhvshc4sZuLAitiHd5Srhf-k_0qSjPLCmQiNaLBcK7LA49G7fXAWzRH4UbqBkCZhD8jXRxIHEYpmFZCvA Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:31:41.318150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec1c332dc5c44eee9c7c81787a435533", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec1c332dc5c44eee9c7c81787a435533"}]}] Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 85a24cb16a864a03920ccb359c13ec79 Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:31:41.319800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': 'cb8f74a7-256c-4810-944b-e4f66773aa13'} Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:31:41.321242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:31:41.322646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:31:41.323965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Returning 404 to user: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:31:41.323965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9c6cbbd6-30d8-4276-8c8d-8cd1f9fbdbb4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 404 len: 111 microversion: 2.20 time: 0.029433 Sep 09 21:31:41.323965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 293/600] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:41 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:31:41.329195 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-478f2a8b-14b1-4e64-9d80-58f97f203681 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '.version_select at 0x7f0816749b80>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:41.354019 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-478f2a8b-14b1-4e64-9d80-58f97f203681 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437852790" status: 204 len: 0 microversion: 2.20 time: 0.028595 Sep 09 21:31:41.354579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 308/601] 10.222.0.46 () {60 vars in 1262 bytes} [Fri Sep 9 21:31:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437852790 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 21:31:42.015230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-dbf38179-d195-45e1-84db-54cf98e1ad06 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Action: 'create', calling method: .version_select at 0x7f0812f92550>, body: {"keypair": {"name": "tempest-keypair-653181110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgZbuh41W4dxZGhjrAOMixwLWbQYoYNaPiGAIFHwEtfSx695fNsmkMro+aj4qEKlRxMfCuUSiHtrHFqwpp3gVNR9ihoXFXrqyv095ZktUgP/XLq0f1NhtF5bGd3YSarrw=="}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:31:42.034471 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-dbf38179-d195-45e1-84db-54cf98e1ad06 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Getting quotas for project ec1c332dc5c44eee9c7c81787a435533. Resources: {'key_pairs'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:31:42.040558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-dbf38179-d195-45e1-84db-54cf98e1ad06 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Getting quotas for user 85a24cb16a864a03920ccb359c13ec79 and project ec1c332dc5c44eee9c7c81787a435533. Resources: {'key_pairs'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:31:42.056752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dbf38179-d195-45e1-84db-54cf98e1ad06 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [03f2d927-0d79-4950-a801-7972d3bfb21f] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 21:31:43.063523 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO oslo.messaging._drivers.impl_rabbit [None req-dbf38179-d195-45e1-84db-54cf98e1ad06 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [03f2d927-0d79-4950-a801-7972d3bfb21f] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36732. Sep 09 21:31:43.080171 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-dbf38179-d195-45e1-84db-54cf98e1ad06 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.069549 Sep 09 21:31:43.080864 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 294/602] 10.222.0.46 () {62 vars in 1200 bytes} [Fri Sep 9 21:31:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1071 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 21:31:44.558827 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1759626507", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7dc3250f-6619-48e3-826b-3b813ae4b435"}], "security_groups": [{"name": "tempest-securitygroup--221262898"}], "key_name": "tempest-keypair-653181110", "user_data": "}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:31:44.676256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.network.neutron [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] validate_networks() for [('7dc3250f-6619-48e3-826b-3b813ae4b435', None, None, None, None, None)] {{(pid=120465) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:31:45.092804 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Flavor limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:31:45.093226 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Image limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:31:45.093702 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Flavor pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:31:45.094111 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Image pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:31:45.094521 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:31:45.103764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:45.104252 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:45.104686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:45.105413 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:45.105866 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:45.106289 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:45.123120 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Getting quotas for project ec1c332dc5c44eee9c7c81787a435533. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:31:45.127030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Getting quotas for user 85a24cb16a864a03920ccb359c13ec79 and project ec1c332dc5c44eee9c7c81787a435533. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:31:45.138054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Going to run 1 instances... {{(pid=120465) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:31:45.140284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:31:45.185254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR oslo.messaging._drivers.impl_rabbit [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [a9e90403-8beb-4f15-a557-fd09d2b93cb7] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 21:31:46.192766 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO oslo.messaging._drivers.impl_rabbit [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [a9e90403-8beb-4f15-a557-fd09d2b93cb7] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36778. Sep 09 21:31:46.196650 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-74450b7a-211d-4159-b72f-0f99d78176df tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.642804 Sep 09 21:31:46.197296 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 309/603] 10.222.0.46 () {62 vars in 1188 bytes} [Fri Sep 9 21:31:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 21:31:46.209412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d58e6c54-596d-446d-b4d3-c1af0036f330 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:46.210028 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d58e6c54-596d-446d-b4d3-c1af0036f330 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:46.265465 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d58e6c54-596d-446d-b4d3-c1af0036f330 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:46.272608 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d58e6c54-596d-446d-b4d3-c1af0036f330 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:46.274605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d58e6c54-596d-446d-b4d3-c1af0036f330 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:46.275711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d58e6c54-596d-446d-b4d3-c1af0036f330 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1281 microversion: 2.20 time: 0.070879 Sep 09 21:31:46.276259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 295/604] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:46 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:47.301240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e3d1d6f0-db8b-43c5-bcdd-c95f697ee6e7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:47.302379 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e3d1d6f0-db8b-43c5-bcdd-c95f697ee6e7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:47.355192 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e3d1d6f0-db8b-43c5-bcdd-c95f697ee6e7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:47.362327 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e3d1d6f0-db8b-43c5-bcdd-c95f697ee6e7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:47.363813 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e3d1d6f0-db8b-43c5-bcdd-c95f697ee6e7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:47.364896 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e3d1d6f0-db8b-43c5-bcdd-c95f697ee6e7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1281 microversion: 2.20 time: 0.068002 Sep 09 21:31:47.365436 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 310/605] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:47 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:48.390257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5bf1b898-aaef-4745-8520-3c257d93f887 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:48.390868 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5bf1b898-aaef-4745-8520-3c257d93f887 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:48.444928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5bf1b898-aaef-4745-8520-3c257d93f887 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:48.453024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5bf1b898-aaef-4745-8520-3c257d93f887 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:48.454498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5bf1b898-aaef-4745-8520-3c257d93f887 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:48.455609 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5bf1b898-aaef-4745-8520-3c257d93f887 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1281 microversion: 2.20 time: 0.069466 Sep 09 21:31:48.456160 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 296/606] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:48 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:49.481451 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-dc760514-aa22-4e1b-a9cb-96e23682f6c2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:49.482064 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-dc760514-aa22-4e1b-a9cb-96e23682f6c2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:49.541455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-dc760514-aa22-4e1b-a9cb-96e23682f6c2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:49.548914 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-dc760514-aa22-4e1b-a9cb-96e23682f6c2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:49.550560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-dc760514-aa22-4e1b-a9cb-96e23682f6c2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:49.551685 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-dc760514-aa22-4e1b-a9cb-96e23682f6c2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1281 microversion: 2.20 time: 0.074730 Sep 09 21:31:49.552225 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 311/607] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:49 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:50.577603 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:50.578280 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:50.584372 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:50.584856 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:50.585292 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:50.585973 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:50.586468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:50.586919 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:50.877754 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:50.886766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:50.888241 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:50.889346 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-56316fa7-1bca-46a9-8257-71f0e2ccfd99 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1285 microversion: 2.20 time: 0.315746 Sep 09 21:31:50.889899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 297/608] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:50 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1285 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:51.914134 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:51.914943 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:51.921533 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:51.922020 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:51.922454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:51.923147 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:51.923629 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:51.924058 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:51.990326 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:51.998849 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:52.000333 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:52.001482 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4d31f08e-e5a5-41a8-ae6d-a55b5b83b596 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1339 microversion: 2.20 time: 0.091319 Sep 09 21:31:52.002045 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 312/609] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:51 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:53.026923 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:53.027551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:53.034868 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:53.035353 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:53.035813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:53.036497 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:53.037124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:53.037545 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:53.046537 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-00b209a5-2302-4700-b4e3-1e0942cf1e71 req-35ad68b7-187b-4af8-8077-551be6b67492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4346b807-8641-4458-98d2-c1072c799994", "tag": "d23cedea-0322-45bd-8b29-1ff96462c426"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:31:53.057931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-00b209a5-2302-4700-b4e3-1e0942cf1e71 req-35ad68b7-187b-4af8-8077-551be6b67492 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:53.058517 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-00b209a5-2302-4700-b4e3-1e0942cf1e71 req-35ad68b7-187b-4af8-8077-551be6b67492 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:53.059031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-00b209a5-2302-4700-b4e3-1e0942cf1e71 req-35ad68b7-187b-4af8-8077-551be6b67492 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:53.070304 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-00b209a5-2302-4700-b4e3-1e0942cf1e71 req-35ad68b7-187b-4af8-8077-551be6b67492 service nova] Creating event network-changed:d23cedea-0322-45bd-8b29-1ff96462c426 for instance 4346b807-8641-4458-98d2-c1072c799994 on hv-cinder-85221 Sep 09 21:31:53.076132 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-00b209a5-2302-4700-b4e3-1e0942cf1e71 req-35ad68b7-187b-4af8-8077-551be6b67492 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033508 Sep 09 21:31:53.076734 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 313/610] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:31:53.275605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:53.284216 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:53.285643 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:53.286733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-cc71ac8a-7453-466b-8e00-641c7f0357fd tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1406 microversion: 2.20 time: 0.264373 Sep 09 21:31:53.287278 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 298/611] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:53 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:54.312769 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:54.313464 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:54.319637 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:54.320125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:54.321224 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:54.321939 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:54.322399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:54.322829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:54.449571 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:54.457527 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:54.458960 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:54.460118 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d847dfab-be81-48b0-b121-41372df09b30 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1406 microversion: 2.20 time: 0.152075 Sep 09 21:31:54.460676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 314/612] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:54 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:55.486345 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:55.486896 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:55.493250 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:55.493882 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:55.494317 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:55.494994 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:55.495451 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:55.495898 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:55.628951 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:55.637736 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:55.639186 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:55.640335 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-41cd6f44-4662-4172-9faf-b9e940f64ea9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1406 microversion: 2.20 time: 0.157947 Sep 09 21:31:55.640885 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 299/613] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:55 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:56.665981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:56.666578 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:56.668864 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:56.674663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:56.675133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:56.675634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:56.676327 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:56.676804 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:56.677223 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:56.810982 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:56.818860 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:56.820315 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:56.822159 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-33a77642-1d8a-4e0e-8bab-c8cd9c9a1258 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1406 microversion: 2.20 time: 0.159528 Sep 09 21:31:56.822709 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 315/614] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:56 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:57.846151 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:57.846939 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:57.849241 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:57.855274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:57.855788 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:57.856224 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:57.856996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:57.857461 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:57.857884 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:57.993904 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:58.001765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:58.003199 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:58.004331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4c05a218-679c-4dd4-a5f5-cebeab778f96 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1406 microversion: 2.20 time: 0.162042 Sep 09 21:31:58.004872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 300/615] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:57 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:59.028850 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:31:59.029546 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:31:59.036870 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:59.037353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:59.037784 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:59.038465 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:59.038914 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:59.039332 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:59.174890 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:59.183621 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:59.185065 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:31:59.186200 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-75f0c070-d80c-4ac3-8113-ab4e25372e27 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1406 microversion: 2.20 time: 0.161648 Sep 09 21:31:59.186758 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 316/616] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:31:59 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:31:59.325022 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=8 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:31:59.382207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-1990e6cf-4a24-437a-a4f6-d4e47d0f5b12 req-b262dcab-d71a-4d54-b16a-ea9e8c30ce97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4346b807-8641-4458-98d2-c1072c799994", "name": "network-vif-plugged", "status": "completed", "tag": "d23cedea-0322-45bd-8b29-1ff96462c426"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:31:59.392158 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-1990e6cf-4a24-437a-a4f6-d4e47d0f5b12 req-b262dcab-d71a-4d54-b16a-ea9e8c30ce97 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:31:59.392655 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-1990e6cf-4a24-437a-a4f6-d4e47d0f5b12 req-b262dcab-d71a-4d54-b16a-ea9e8c30ce97 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:31:59.393087 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-1990e6cf-4a24-437a-a4f6-d4e47d0f5b12 req-b262dcab-d71a-4d54-b16a-ea9e8c30ce97 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:31:59.404311 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-1990e6cf-4a24-437a-a4f6-d4e47d0f5b12 req-b262dcab-d71a-4d54-b16a-ea9e8c30ce97 service nova] Creating event network-vif-plugged:d23cedea-0322-45bd-8b29-1ff96462c426 for instance 4346b807-8641-4458-98d2-c1072c799994 on hv-cinder-85221 Sep 09 21:31:59.409349 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-1990e6cf-4a24-437a-a4f6-d4e47d0f5b12 req-b262dcab-d71a-4d54-b16a-ea9e8c30ce97 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089741 Sep 09 21:31:59.409914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 301/617] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:32:00.211872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:00.212497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:00.215050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=10 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:00.220711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:00.221194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:00.221629 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:00.222316 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:00.222771 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:00.223195 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:00.354865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:00.362954 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:00.364401 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:00.365496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4a768bcc-e696-4312-affe-37d8cd931152 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1406 microversion: 2.20 time: 0.157575 Sep 09 21:32:00.366047 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 317/618] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:32:00 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:32:01.391516 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:01.392219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:01.398555 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:01.398993 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:01.399439 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:01.400175 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:01.401367 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:01.402096 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:01.546448 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:01.558021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:01.560112 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:01.561361 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1f5e7046-0c0a-4f1f-8163-5304e83e8f69 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1598 microversion: 2.20 time: 0.174591 Sep 09 21:32:01.561918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 302/619] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:32:01 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:32:01.586213 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d4ea2b64-4064-480d-8909-a4ab3b553d16 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:01.586705 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d4ea2b64-4064-480d-8909-a4ab3b553d16 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:01.589393 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:01.594696 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4ea2b64-4064-480d-8909-a4ab3b553d16 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:01.595192 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4ea2b64-4064-480d-8909-a4ab3b553d16 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:01.595734 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4ea2b64-4064-480d-8909-a4ab3b553d16 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:01.596428 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4ea2b64-4064-480d-8909-a4ab3b553d16 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:01.596885 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4ea2b64-4064-480d-8909-a4ab3b553d16 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:01.597311 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4ea2b64-4064-480d-8909-a4ab3b553d16 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:01.679633 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d4ea2b64-4064-480d-8909-a4ab3b553d16 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097202 Sep 09 21:32:01.680209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 318/620] 10.222.0.46 () {60 vars in 1316 bytes} [Fri Sep 9 21:32:01 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:32:02.797165 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-fed5b7d8-41f9-4823-b40f-ce7e8c07ca95 req-95503b7e-3104-48ed-90fc-deb91136b41e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4346b807-8641-4458-98d2-c1072c799994", "tag": "d23cedea-0322-45bd-8b29-1ff96462c426"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:02.807177 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-fed5b7d8-41f9-4823-b40f-ce7e8c07ca95 req-95503b7e-3104-48ed-90fc-deb91136b41e service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:02.807711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-fed5b7d8-41f9-4823-b40f-ce7e8c07ca95 req-95503b7e-3104-48ed-90fc-deb91136b41e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:02.808146 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-fed5b7d8-41f9-4823-b40f-ce7e8c07ca95 req-95503b7e-3104-48ed-90fc-deb91136b41e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:02.819872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-fed5b7d8-41f9-4823-b40f-ce7e8c07ca95 req-95503b7e-3104-48ed-90fc-deb91136b41e service nova] Creating event network-changed:d23cedea-0322-45bd-8b29-1ff96462c426 for instance 4346b807-8641-4458-98d2-c1072c799994 on hv-cinder-85221 Sep 09 21:32:02.825181 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-fed5b7d8-41f9-4823-b40f-ce7e8c07ca95 req-95503b7e-3104-48ed-90fc-deb91136b41e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153828 Sep 09 21:32:02.825797 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 303/621] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:32:09.498162 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-045b18fc-351b-4012-8960-c8df3ba9726b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:09.498765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-045b18fc-351b-4012-8960-c8df3ba9726b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:09.504770 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-045b18fc-351b-4012-8960-c8df3ba9726b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:09.505257 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-045b18fc-351b-4012-8960-c8df3ba9726b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:09.505696 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-045b18fc-351b-4012-8960-c8df3ba9726b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:09.506391 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-045b18fc-351b-4012-8960-c8df3ba9726b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:09.506849 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-045b18fc-351b-4012-8960-c8df3ba9726b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:09.507276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-045b18fc-351b-4012-8960-c8df3ba9726b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:09.511002 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:09.531342 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-045b18fc-351b-4012-8960-c8df3ba9726b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lazy-loading 'flavor' on Instance uuid 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:32:09.600447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-045b18fc-351b-4012-8960-c8df3ba9726b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "POST /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5/action" status: 202 len: 0 microversion: 2.1 time: 0.107059 Sep 09 21:32:09.601014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 319/622] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:32:09 2022] POST /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:32:09.612106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-82b663ee-46be-4bb1-9f9c-a2e088a99eaf tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:09.612807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-82b663ee-46be-4bb1-9f9c-a2e088a99eaf tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:09.619225 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82b663ee-46be-4bb1-9f9c-a2e088a99eaf tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:09.619794 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82b663ee-46be-4bb1-9f9c-a2e088a99eaf tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:09.620557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82b663ee-46be-4bb1-9f9c-a2e088a99eaf tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:09.621518 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82b663ee-46be-4bb1-9f9c-a2e088a99eaf tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:09.622247 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82b663ee-46be-4bb1-9f9c-a2e088a99eaf tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:09.622761 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-82b663ee-46be-4bb1-9f9c-a2e088a99eaf tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:09.627002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=55 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:09.762827 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-82b663ee-46be-4bb1-9f9c-a2e088a99eaf tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:09.770435 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-82b663ee-46be-4bb1-9f9c-a2e088a99eaf tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.164620 Sep 09 21:32:09.770990 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 304/623] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:09 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:10.796186 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0ae9bba6-c2fb-4c75-905a-8def9b52777d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:10.796886 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0ae9bba6-c2fb-4c75-905a-8def9b52777d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:10.803015 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0ae9bba6-c2fb-4c75-905a-8def9b52777d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:10.803507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0ae9bba6-c2fb-4c75-905a-8def9b52777d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:10.803979 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0ae9bba6-c2fb-4c75-905a-8def9b52777d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:10.804673 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0ae9bba6-c2fb-4c75-905a-8def9b52777d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:10.805137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0ae9bba6-c2fb-4c75-905a-8def9b52777d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:10.805577 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0ae9bba6-c2fb-4c75-905a-8def9b52777d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:10.939393 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0ae9bba6-c2fb-4c75-905a-8def9b52777d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:10.947024 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0ae9bba6-c2fb-4c75-905a-8def9b52777d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.156445 Sep 09 21:32:10.947677 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 320/624] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:10 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:11.969574 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e59de32e-b3f1-4c91-8a42-633fa7e4f2d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:11.970181 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e59de32e-b3f1-4c91-8a42-633fa7e4f2d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:11.976883 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e59de32e-b3f1-4c91-8a42-633fa7e4f2d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:11.977378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e59de32e-b3f1-4c91-8a42-633fa7e4f2d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:11.977829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e59de32e-b3f1-4c91-8a42-633fa7e4f2d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:11.978520 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e59de32e-b3f1-4c91-8a42-633fa7e4f2d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:11.979506 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e59de32e-b3f1-4c91-8a42-633fa7e4f2d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:11.979955 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e59de32e-b3f1-4c91-8a42-633fa7e4f2d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:12.110060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e59de32e-b3f1-4c91-8a42-633fa7e4f2d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:12.117776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e59de32e-b3f1-4c91-8a42-633fa7e4f2d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.152302 Sep 09 21:32:12.118340 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 305/625] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:11 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:13.142010 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a433c8e6-1b70-4065-9aca-847e18eb5f18 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:13.142626 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a433c8e6-1b70-4065-9aca-847e18eb5f18 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:13.148831 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a433c8e6-1b70-4065-9aca-847e18eb5f18 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:13.149323 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a433c8e6-1b70-4065-9aca-847e18eb5f18 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:13.149791 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a433c8e6-1b70-4065-9aca-847e18eb5f18 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:13.150478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a433c8e6-1b70-4065-9aca-847e18eb5f18 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:13.151141 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a433c8e6-1b70-4065-9aca-847e18eb5f18 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:13.151822 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a433c8e6-1b70-4065-9aca-847e18eb5f18 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:13.282722 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a433c8e6-1b70-4065-9aca-847e18eb5f18 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:13.290334 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a433c8e6-1b70-4065-9aca-847e18eb5f18 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.152323 Sep 09 21:32:13.290881 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 321/626] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:13 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:14.314506 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-48096b2a-5911-4f60-840a-15e2a8b453d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:14.315109 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-48096b2a-5911-4f60-840a-15e2a8b453d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:14.321425 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48096b2a-5911-4f60-840a-15e2a8b453d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:14.321906 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48096b2a-5911-4f60-840a-15e2a8b453d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:14.322446 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48096b2a-5911-4f60-840a-15e2a8b453d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:14.323236 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48096b2a-5911-4f60-840a-15e2a8b453d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:14.323723 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48096b2a-5911-4f60-840a-15e2a8b453d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:14.324145 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48096b2a-5911-4f60-840a-15e2a8b453d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:14.471235 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-48096b2a-5911-4f60-840a-15e2a8b453d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:14.480047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-48096b2a-5911-4f60-840a-15e2a8b453d2 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.168447 Sep 09 21:32:14.480973 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 306/627] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:14 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:15.503593 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-159cb7fd-bdf4-4078-9a97-60f748e2dc99 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:15.504208 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-159cb7fd-bdf4-4078-9a97-60f748e2dc99 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:15.511763 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-159cb7fd-bdf4-4078-9a97-60f748e2dc99 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:15.512252 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-159cb7fd-bdf4-4078-9a97-60f748e2dc99 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:15.512691 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-159cb7fd-bdf4-4078-9a97-60f748e2dc99 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:15.513381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-159cb7fd-bdf4-4078-9a97-60f748e2dc99 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:15.513844 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-159cb7fd-bdf4-4078-9a97-60f748e2dc99 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:15.514268 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-159cb7fd-bdf4-4078-9a97-60f748e2dc99 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:15.650622 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-159cb7fd-bdf4-4078-9a97-60f748e2dc99 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:15.658860 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-159cb7fd-bdf4-4078-9a97-60f748e2dc99 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.159300 Sep 09 21:32:15.659416 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 322/628] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:15 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:16.683795 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6a70a3dc-0d3b-4014-8d98-5dfe4c05d913 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:16.684413 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6a70a3dc-0d3b-4014-8d98-5dfe4c05d913 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:16.690760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a70a3dc-0d3b-4014-8d98-5dfe4c05d913 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:16.691236 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a70a3dc-0d3b-4014-8d98-5dfe4c05d913 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:16.691708 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a70a3dc-0d3b-4014-8d98-5dfe4c05d913 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:16.692422 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a70a3dc-0d3b-4014-8d98-5dfe4c05d913 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:16.692873 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a70a3dc-0d3b-4014-8d98-5dfe4c05d913 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:16.693292 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a70a3dc-0d3b-4014-8d98-5dfe4c05d913 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:16.824495 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6a70a3dc-0d3b-4014-8d98-5dfe4c05d913 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:16.832167 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6a70a3dc-0d3b-4014-8d98-5dfe4c05d913 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.153339 Sep 09 21:32:16.832755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 307/629] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:16 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:17.856729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3130acbc-095d-40b1-b66b-90ecf7fb248d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:17.857264 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3130acbc-095d-40b1-b66b-90ecf7fb248d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:17.863646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3130acbc-095d-40b1-b66b-90ecf7fb248d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:17.864133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3130acbc-095d-40b1-b66b-90ecf7fb248d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:17.864572 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3130acbc-095d-40b1-b66b-90ecf7fb248d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:17.865267 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3130acbc-095d-40b1-b66b-90ecf7fb248d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:17.865720 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3130acbc-095d-40b1-b66b-90ecf7fb248d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:17.866145 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3130acbc-095d-40b1-b66b-90ecf7fb248d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:17.998521 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3130acbc-095d-40b1-b66b-90ecf7fb248d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:18.006127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3130acbc-095d-40b1-b66b-90ecf7fb248d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.154197 Sep 09 21:32:18.006682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 323/630] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:17 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:19.030203 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-7de3ba18-fdca-45fb-85a5-4c1d6357e2a7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:19.030817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-7de3ba18-fdca-45fb-85a5-4c1d6357e2a7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:19.038346 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7de3ba18-fdca-45fb-85a5-4c1d6357e2a7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:19.038858 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7de3ba18-fdca-45fb-85a5-4c1d6357e2a7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:19.039291 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7de3ba18-fdca-45fb-85a5-4c1d6357e2a7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:19.040008 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7de3ba18-fdca-45fb-85a5-4c1d6357e2a7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:19.040457 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7de3ba18-fdca-45fb-85a5-4c1d6357e2a7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:19.040930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7de3ba18-fdca-45fb-85a5-4c1d6357e2a7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:19.176087 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7de3ba18-fdca-45fb-85a5-4c1d6357e2a7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:19.184290 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-7de3ba18-fdca-45fb-85a5-4c1d6357e2a7 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.158436 Sep 09 21:32:19.184844 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 308/631] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:19 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:20.207050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ec4d41c3-4d03-4070-9e9e-f38fbb58751f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:20.207741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ec4d41c3-4d03-4070-9e9e-f38fbb58751f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:20.214281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec4d41c3-4d03-4070-9e9e-f38fbb58751f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:20.214998 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec4d41c3-4d03-4070-9e9e-f38fbb58751f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:20.215579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec4d41c3-4d03-4070-9e9e-f38fbb58751f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:20.216392 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec4d41c3-4d03-4070-9e9e-f38fbb58751f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:20.216851 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec4d41c3-4d03-4070-9e9e-f38fbb58751f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:20.217275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ec4d41c3-4d03-4070-9e9e-f38fbb58751f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:20.354455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ec4d41c3-4d03-4070-9e9e-f38fbb58751f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:20.362770 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ec4d41c3-4d03-4070-9e9e-f38fbb58751f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.159536 Sep 09 21:32:20.363327 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 324/632] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:20 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:20.389175 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-91be6eb0-1631-43ce-a10d-29c584a02635 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:20.391405 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-91be6eb0-1631-43ce-a10d-29c584a02635 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:20.397452 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-91be6eb0-1631-43ce-a10d-29c584a02635 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:20.397940 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-91be6eb0-1631-43ce-a10d-29c584a02635 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:20.398379 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-91be6eb0-1631-43ce-a10d-29c584a02635 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:20.399071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-91be6eb0-1631-43ce-a10d-29c584a02635 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:20.399551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-91be6eb0-1631-43ce-a10d-29c584a02635 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:20.399985 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-91be6eb0-1631-43ce-a10d-29c584a02635 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:20.428713 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-91be6eb0-1631-43ce-a10d-29c584a02635 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043861 Sep 09 21:32:20.429254 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 309/633] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:32:20 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:32:20.494014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3417cd76-1d39-47f3-a97b-da4c7d174586 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:20.494514 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3417cd76-1d39-47f3-a97b-da4c7d174586 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:20.500484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3417cd76-1d39-47f3-a97b-da4c7d174586 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:20.500967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3417cd76-1d39-47f3-a97b-da4c7d174586 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:20.501399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3417cd76-1d39-47f3-a97b-da4c7d174586 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:20.502076 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3417cd76-1d39-47f3-a97b-da4c7d174586 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:20.502528 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3417cd76-1d39-47f3-a97b-da4c7d174586 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:20.502947 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3417cd76-1d39-47f3-a97b-da4c7d174586 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:20.528161 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3417cd76-1d39-47f3-a97b-da4c7d174586 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:32:20.601403 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3417cd76-1d39-47f3-a97b-da4c7d174586 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 204 len: 0 microversion: 2.1 time: 0.110801 Sep 09 21:32:20.601915 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 325/634] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:32:20 2022] DELETE /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:32:20.613632 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c96b7550-2951-4679-82c5-28d594c01834 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:20.614241 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c96b7550-2951-4679-82c5-28d594c01834 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:20.620125 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c96b7550-2951-4679-82c5-28d594c01834 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:20.620719 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c96b7550-2951-4679-82c5-28d594c01834 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:20.621458 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c96b7550-2951-4679-82c5-28d594c01834 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:20.622150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c96b7550-2951-4679-82c5-28d594c01834 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:20.622605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c96b7550-2951-4679-82c5-28d594c01834 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:20.623028 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c96b7550-2951-4679-82c5-28d594c01834 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:20.751526 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c96b7550-2951-4679-82c5-28d594c01834 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:20.759036 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c96b7550-2951-4679-82c5-28d594c01834 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1674 microversion: 2.1 time: 0.151663 Sep 09 21:32:20.759605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 310/635] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:20 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:32:21.387977 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ee1d16ee-28f8-4647-904c-f4833cb91cad tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:21.388969 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ee1d16ee-28f8-4647-904c-f4833cb91cad tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:21.395570 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1d16ee-28f8-4647-904c-f4833cb91cad tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:21.396212 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1d16ee-28f8-4647-904c-f4833cb91cad tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:21.396674 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1d16ee-28f8-4647-904c-f4833cb91cad tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:21.397395 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1d16ee-28f8-4647-904c-f4833cb91cad tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:21.398020 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1d16ee-28f8-4647-904c-f4833cb91cad tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:21.398506 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee1d16ee-28f8-4647-904c-f4833cb91cad tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:21.537498 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ee1d16ee-28f8-4647-904c-f4833cb91cad tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:21.545717 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ee1d16ee-28f8-4647-904c-f4833cb91cad tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.162664 Sep 09 21:32:21.546277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 326/636] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:21 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:21.782628 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e20c8604-2182-46f7-ab57-dcfcb6416efc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:21.783240 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e20c8604-2182-46f7-ab57-dcfcb6416efc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:21.789650 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e20c8604-2182-46f7-ab57-dcfcb6416efc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:21.790142 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e20c8604-2182-46f7-ab57-dcfcb6416efc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:21.790582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e20c8604-2182-46f7-ab57-dcfcb6416efc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:21.791266 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e20c8604-2182-46f7-ab57-dcfcb6416efc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:21.791758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e20c8604-2182-46f7-ab57-dcfcb6416efc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:21.792188 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e20c8604-2182-46f7-ab57-dcfcb6416efc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:21.922314 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e20c8604-2182-46f7-ab57-dcfcb6416efc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:21.929947 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e20c8604-2182-46f7-ab57-dcfcb6416efc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1674 microversion: 2.1 time: 0.151471 Sep 09 21:32:21.930501 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 311/637] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:21 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:22.569591 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f77bf754-383d-42c2-82c0-bd6d006e8577 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:22.570446 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f77bf754-383d-42c2-82c0-bd6d006e8577 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:22.577992 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f77bf754-383d-42c2-82c0-bd6d006e8577 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:22.578514 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f77bf754-383d-42c2-82c0-bd6d006e8577 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:22.578951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f77bf754-383d-42c2-82c0-bd6d006e8577 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:22.579671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f77bf754-383d-42c2-82c0-bd6d006e8577 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:22.580127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f77bf754-383d-42c2-82c0-bd6d006e8577 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:22.580549 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f77bf754-383d-42c2-82c0-bd6d006e8577 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:22.715966 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f77bf754-383d-42c2-82c0-bd6d006e8577 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:22.723873 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f77bf754-383d-42c2-82c0-bd6d006e8577 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.158170 Sep 09 21:32:22.725327 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 327/638] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:22 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:22.955851 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-97eee663-affa-4c0b-aef4-f5451d2a5dc2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:22.956460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-97eee663-affa-4c0b-aef4-f5451d2a5dc2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:22.962840 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-97eee663-affa-4c0b-aef4-f5451d2a5dc2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:22.963322 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-97eee663-affa-4c0b-aef4-f5451d2a5dc2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:22.963787 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-97eee663-affa-4c0b-aef4-f5451d2a5dc2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:22.964622 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-97eee663-affa-4c0b-aef4-f5451d2a5dc2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:22.965079 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-97eee663-affa-4c0b-aef4-f5451d2a5dc2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:22.965499 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-97eee663-affa-4c0b-aef4-f5451d2a5dc2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:23.037420 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-97eee663-affa-4c0b-aef4-f5451d2a5dc2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:23.045715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-97eee663-affa-4c0b-aef4-f5451d2a5dc2 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1606 microversion: 2.1 time: 0.093826 Sep 09 21:32:23.046278 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 312/639] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:22 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:23.209476 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-026e749a-2b4c-45a0-9e1b-f25c568fee09 req-05499ff3-4ceb-4718-8ed6-1ff63f9ca9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27906035-8bb1-450e-bb91-c40551e1a437", "name": "network-vif-deleted", "tag": "6bb94d88-fa7a-411f-a02b-1791dad73802"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:23.219264 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-026e749a-2b4c-45a0-9e1b-f25c568fee09 req-05499ff3-4ceb-4718-8ed6-1ff63f9ca9ff service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:23.219808 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-026e749a-2b4c-45a0-9e1b-f25c568fee09 req-05499ff3-4ceb-4718-8ed6-1ff63f9ca9ff service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:23.220238 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-026e749a-2b4c-45a0-9e1b-f25c568fee09 req-05499ff3-4ceb-4718-8ed6-1ff63f9ca9ff service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:23.233235 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-026e749a-2b4c-45a0-9e1b-f25c568fee09 req-05499ff3-4ceb-4718-8ed6-1ff63f9ca9ff service nova] Creating event network-vif-deleted:6bb94d88-fa7a-411f-a02b-1791dad73802 for instance 27906035-8bb1-450e-bb91-c40551e1a437 on hv-cinder-85221 Sep 09 21:32:23.238490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-026e749a-2b4c-45a0-9e1b-f25c568fee09 req-05499ff3-4ceb-4718-8ed6-1ff63f9ca9ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032654 Sep 09 21:32:23.239138 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 328/640] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:32:23.747977 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d3522c65-9c1a-4206-95ae-dd0c4ca6ef60 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:23.748723 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d3522c65-9c1a-4206-95ae-dd0c4ca6ef60 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:23.754973 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3522c65-9c1a-4206-95ae-dd0c4ca6ef60 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:23.755570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3522c65-9c1a-4206-95ae-dd0c4ca6ef60 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:23.756215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3522c65-9c1a-4206-95ae-dd0c4ca6ef60 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:23.757077 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3522c65-9c1a-4206-95ae-dd0c4ca6ef60 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:23.757605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3522c65-9c1a-4206-95ae-dd0c4ca6ef60 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:23.758136 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d3522c65-9c1a-4206-95ae-dd0c4ca6ef60 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:23.891966 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d3522c65-9c1a-4206-95ae-dd0c4ca6ef60 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:23.900668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d3522c65-9c1a-4206-95ae-dd0c4ca6ef60 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.156851 Sep 09 21:32:23.901241 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 313/641] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:23 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:32:24.069151 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:24.070561 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:24.082934 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:24.083813 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:24.084537 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:24.085486 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:24.086136 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:24.086754 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:24.124273 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:24.125050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:24.125682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:24.126318 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lazy-loading 'fault' on Instance uuid 27906035-8bb1-450e-bb91-c40551e1a437 {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:32:24.178274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:24.186327 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a6eb4821-dd7f-4f66-84f6-b5cc2d114683 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 200 len: 1328 microversion: 2.1 time: 0.121367 Sep 09 21:32:24.187088 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 329/642] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:24 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:32:24.925931 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e5118c0d-837b-46cb-a6f3-e1787d472fa3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:24.927258 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e5118c0d-837b-46cb-a6f3-e1787d472fa3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:24.934060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5118c0d-837b-46cb-a6f3-e1787d472fa3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:24.934740 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5118c0d-837b-46cb-a6f3-e1787d472fa3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:24.935192 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5118c0d-837b-46cb-a6f3-e1787d472fa3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:24.935934 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5118c0d-837b-46cb-a6f3-e1787d472fa3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:24.936842 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5118c0d-837b-46cb-a6f3-e1787d472fa3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:24.937287 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e5118c0d-837b-46cb-a6f3-e1787d472fa3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:25.080217 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e5118c0d-837b-46cb-a6f3-e1787d472fa3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:25.088047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e5118c0d-837b-46cb-a6f3-e1787d472fa3 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.165920 Sep 09 21:32:25.088614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 314/643] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:24 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:25.210344 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:25.210985 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:25.218086 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:25.218575 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:25.219004 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:25.219788 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:25.220241 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:25.220658 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:25.234728 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] HTTP exception thrown: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Request method failure captured: Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 HTTP/1.1 Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG69EapCyCGGc3hRYbIGkqNpvuqGKT0tY758GEc6_AqVlDsSa8PrdS9dL4WWdw2DXO0n1FngWWkGfn9yOzAVAh0s-V1H5j6f7Ujb-K99btRI8HiJ9UD0Dxm9r0Niz9ZT82ndndjFVPLQ0atzfbdiHBYHE0ST9CTVbs5kEzqzVdTMj-c0 Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:32:25.236454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bc8ed5f414b947e2ab1815f5a775a2c5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bc8ed5f414b947e2ab1815f5a775a2c5"}]}] Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 8c37b14f268f4180a618aa8eeefb5bc6 Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:32:25.237838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '27906035-8bb1-450e-bb91-c40551e1a437'} Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:32:25.238719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:32:25.240046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:32:25.241154 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Returning 404 to user: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:32:25.241154 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7b9f5798-77cc-4045-b423-d11aa00a8fc1 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 404 len: 111 microversion: 2.1 time: 0.031347 Sep 09 21:32:25.241154 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 330/644] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:25 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:32:25.248259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6929ee11-e69f-49fd-933a-5a1541918276 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '.version_select at 0x7f0812ec3c10>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:25.269812 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6929ee11-e69f-49fd-933a-5a1541918276 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797152783" status: 202 len: 0 microversion: 2.1 time: 0.025639 Sep 09 21:32:25.270598 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 315/645] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 21:32:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797152783 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:32:25.962424 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7264c716-88a2-414b-9230-deffdc0a9f48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'create', calling method: .version_select at 0x7f0816746430>, body: {"keypair": {"name": "tempest-keypair-1438987703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9tKfl5AdXKsbOrGUjSbGWNmuR3Mn5VXKTWEYXVxzwyYnXypuiAfE6btPRRjM/gEt4LyIh+ss3lfjuHgtuPai9ZkPxn155TxLwigfvxwGP2qdTO0JBg8SWdFRNDhPOQnQ=="}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:25.979012 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-7264c716-88a2-414b-9230-deffdc0a9f48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Getting quotas for project bc8ed5f414b947e2ab1815f5a775a2c5. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:32:25.982967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-7264c716-88a2-414b-9230-deffdc0a9f48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Getting quotas for user 8c37b14f268f4180a618aa8eeefb5bc6 and project bc8ed5f414b947e2ab1815f5a775a2c5. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:32:26.005824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7264c716-88a2-414b-9230-deffdc0a9f48 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047180 Sep 09 21:32:26.006387 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 331/646] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 21:32:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:32:26.112797 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e09594ca-c68c-4523-80be-7cdf03437c44 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:26.113488 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e09594ca-c68c-4523-80be-7cdf03437c44 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:26.120146 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e09594ca-c68c-4523-80be-7cdf03437c44 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:26.121271 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e09594ca-c68c-4523-80be-7cdf03437c44 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:26.121703 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e09594ca-c68c-4523-80be-7cdf03437c44 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:26.122384 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e09594ca-c68c-4523-80be-7cdf03437c44 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:26.122835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e09594ca-c68c-4523-80be-7cdf03437c44 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:26.123255 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e09594ca-c68c-4523-80be-7cdf03437c44 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:26.321929 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e09594ca-c68c-4523-80be-7cdf03437c44 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:26.330232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e09594ca-c68c-4523-80be-7cdf03437c44 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.221874 Sep 09 21:32:26.330835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 316/647] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:26 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:27.354054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3bc41dcd-0299-493d-80a3-24720907eb7c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:27.354642 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-397611380", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "192eabe0-1e5d-4d95-b42d-c42257bcd236"}], "security_groups": [{"name": "tempest-securitygroup--1827191545"}], "key_name": "tempest-keypair-1438987703", "user_data": "}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:27.355095 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3bc41dcd-0299-493d-80a3-24720907eb7c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:27.361649 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3bc41dcd-0299-493d-80a3-24720907eb7c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:27.362128 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3bc41dcd-0299-493d-80a3-24720907eb7c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:27.362560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3bc41dcd-0299-493d-80a3-24720907eb7c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:27.363245 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3bc41dcd-0299-493d-80a3-24720907eb7c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:27.363803 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3bc41dcd-0299-493d-80a3-24720907eb7c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:27.364227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3bc41dcd-0299-493d-80a3-24720907eb7c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:27.459809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] validate_networks() for [('192eabe0-1e5d-4d95-b42d-c42257bcd236', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:32:27.499394 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3bc41dcd-0299-493d-80a3-24720907eb7c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:27.507118 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3bc41dcd-0299-493d-80a3-24720907eb7c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.157417 Sep 09 21:32:27.507680 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 332/648] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:27 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:27.835390 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:32:27.835848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:32:27.836315 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:32:27.836748 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:32:27.837151 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:32:27.846313 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:27.846791 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:27.847225 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:27.847994 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:27.848445 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:27.848862 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:27.864970 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Getting quotas for project bc8ed5f414b947e2ab1815f5a775a2c5. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:32:27.867016 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:27.869622 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Getting quotas for user 8c37b14f268f4180a618aa8eeefb5bc6 and project bc8ed5f414b947e2ab1815f5a775a2c5. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:32:27.881696 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:32:27.883966 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:32:27.930705 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d383a4e6-6615-4a98-ac60-3fd2ff240491 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.580220 Sep 09 21:32:27.931388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 317/649] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:32:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 21:32:27.943398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-08c6d58f-13bd-4d6b-9933-67cd71067238 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:27.944260 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-08c6d58f-13bd-4d6b-9933-67cd71067238 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:27.998645 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-08c6d58f-13bd-4d6b-9933-67cd71067238 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:28.005315 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-08c6d58f-13bd-4d6b-9933-67cd71067238 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1237 microversion: 2.1 time: 0.065761 Sep 09 21:32:28.005872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 333/650] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:27 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:28.532072 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-951804ca-501d-41b4-80ac-5aa95d49e8b9 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:28.532848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-951804ca-501d-41b4-80ac-5aa95d49e8b9 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:28.540797 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-951804ca-501d-41b4-80ac-5aa95d49e8b9 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:28.541290 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-951804ca-501d-41b4-80ac-5aa95d49e8b9 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:28.541729 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-951804ca-501d-41b4-80ac-5aa95d49e8b9 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:28.543226 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-951804ca-501d-41b4-80ac-5aa95d49e8b9 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:28.543722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-951804ca-501d-41b4-80ac-5aa95d49e8b9 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:28.544152 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-951804ca-501d-41b4-80ac-5aa95d49e8b9 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:28.767342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-951804ca-501d-41b4-80ac-5aa95d49e8b9 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:28.774807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-951804ca-501d-41b4-80ac-5aa95d49e8b9 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.247101 Sep 09 21:32:28.775580 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 318/651] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:28 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:29.030688 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-41eac3cd-a178-4de4-bdb7-275c8db34475 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:29.031337 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-41eac3cd-a178-4de4-bdb7-275c8db34475 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:29.038367 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-41eac3cd-a178-4de4-bdb7-275c8db34475 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:29.038854 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-41eac3cd-a178-4de4-bdb7-275c8db34475 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:29.039296 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-41eac3cd-a178-4de4-bdb7-275c8db34475 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:29.040004 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-41eac3cd-a178-4de4-bdb7-275c8db34475 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:29.040464 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-41eac3cd-a178-4de4-bdb7-275c8db34475 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:29.040925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-41eac3cd-a178-4de4-bdb7-275c8db34475 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:29.102468 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-41eac3cd-a178-4de4-bdb7-275c8db34475 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:29.110781 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-41eac3cd-a178-4de4-bdb7-275c8db34475 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1289 microversion: 2.1 time: 0.085055 Sep 09 21:32:29.111330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 334/652] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:29 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:29.799277 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e05165e3-2324-4190-935b-2c28366926b8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:29.799869 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e05165e3-2324-4190-935b-2c28366926b8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:29.806210 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e05165e3-2324-4190-935b-2c28366926b8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:29.806696 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e05165e3-2324-4190-935b-2c28366926b8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:29.807135 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e05165e3-2324-4190-935b-2c28366926b8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:29.807848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e05165e3-2324-4190-935b-2c28366926b8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:29.808304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e05165e3-2324-4190-935b-2c28366926b8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:29.809810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e05165e3-2324-4190-935b-2c28366926b8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:29.941631 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e05165e3-2324-4190-935b-2c28366926b8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:29.949915 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e05165e3-2324-4190-935b-2c28366926b8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.153942 Sep 09 21:32:29.950515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 319/653] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:29 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:30.134331 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-936c6a46-0955-4844-91ec-008f6a90f4a6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:30.134865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-936c6a46-0955-4844-91ec-008f6a90f4a6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:30.142189 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-936c6a46-0955-4844-91ec-008f6a90f4a6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:30.142670 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-936c6a46-0955-4844-91ec-008f6a90f4a6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:30.143107 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-936c6a46-0955-4844-91ec-008f6a90f4a6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:30.143816 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-936c6a46-0955-4844-91ec-008f6a90f4a6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:30.144277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-936c6a46-0955-4844-91ec-008f6a90f4a6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:30.144702 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-936c6a46-0955-4844-91ec-008f6a90f4a6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:30.148646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:30.208277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-936c6a46-0955-4844-91ec-008f6a90f4a6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:30.215942 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-936c6a46-0955-4844-91ec-008f6a90f4a6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1289 microversion: 2.1 time: 0.085520 Sep 09 21:32:30.216535 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 335/654] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:30 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:30.973063 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c9a678ae-d7bc-4070-a980-2d3a0d08d43d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:30.973666 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c9a678ae-d7bc-4070-a980-2d3a0d08d43d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:30.980592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9a678ae-d7bc-4070-a980-2d3a0d08d43d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:30.981173 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9a678ae-d7bc-4070-a980-2d3a0d08d43d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:30.981665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9a678ae-d7bc-4070-a980-2d3a0d08d43d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:30.982360 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9a678ae-d7bc-4070-a980-2d3a0d08d43d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:30.982813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9a678ae-d7bc-4070-a980-2d3a0d08d43d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:30.983237 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c9a678ae-d7bc-4070-a980-2d3a0d08d43d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:31.191100 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c9a678ae-d7bc-4070-a980-2d3a0d08d43d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:31.201935 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c9a678ae-d7bc-4070-a980-2d3a0d08d43d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.232213 Sep 09 21:32:31.202612 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 320/655] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:30 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:31.240655 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bd9322c2-a01a-4a95-9fb6-ad3b05ef5556 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:31.241456 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bd9322c2-a01a-4a95-9fb6-ad3b05ef5556 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:31.248375 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd9322c2-a01a-4a95-9fb6-ad3b05ef5556 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:31.248873 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd9322c2-a01a-4a95-9fb6-ad3b05ef5556 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:31.249314 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd9322c2-a01a-4a95-9fb6-ad3b05ef5556 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:31.250039 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd9322c2-a01a-4a95-9fb6-ad3b05ef5556 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:31.250832 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd9322c2-a01a-4a95-9fb6-ad3b05ef5556 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:31.251281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd9322c2-a01a-4a95-9fb6-ad3b05ef5556 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:31.327668 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bd9322c2-a01a-4a95-9fb6-ad3b05ef5556 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:31.336485 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bd9322c2-a01a-4a95-9fb6-ad3b05ef5556 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1295 microversion: 2.1 time: 0.100549 Sep 09 21:32:31.343616 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 336/656] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:31 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:32.226282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2079792e-1571-4f8d-a858-18cc850fe509 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:32.226852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2079792e-1571-4f8d-a858-18cc850fe509 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:32.234083 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2079792e-1571-4f8d-a858-18cc850fe509 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:32.234692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2079792e-1571-4f8d-a858-18cc850fe509 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:32.235135 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2079792e-1571-4f8d-a858-18cc850fe509 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:32.235851 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2079792e-1571-4f8d-a858-18cc850fe509 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:32.236420 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2079792e-1571-4f8d-a858-18cc850fe509 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:32.236714 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2079792e-1571-4f8d-a858-18cc850fe509 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:32.362552 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4efcf1fb-4f8e-4a0a-bad8-1d22bf3af16d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:32.363745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4efcf1fb-4f8e-4a0a-bad8-1d22bf3af16d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:32.367218 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:32.371744 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4efcf1fb-4f8e-4a0a-bad8-1d22bf3af16d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:32.372458 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4efcf1fb-4f8e-4a0a-bad8-1d22bf3af16d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:32.373156 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4efcf1fb-4f8e-4a0a-bad8-1d22bf3af16d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:32.373969 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4efcf1fb-4f8e-4a0a-bad8-1d22bf3af16d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:32.374422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4efcf1fb-4f8e-4a0a-bad8-1d22bf3af16d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:32.375036 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4efcf1fb-4f8e-4a0a-bad8-1d22bf3af16d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:32.468293 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2079792e-1571-4f8d-a858-18cc850fe509 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:32.476360 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2079792e-1571-4f8d-a858-18cc850fe509 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1507 microversion: 2.1 time: 0.253969 Sep 09 21:32:32.477148 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 321/657] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:32 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:32:32.502640 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-a8d00c6f-2acc-4765-8ad0-c591439d1302 req-2d1903c4-a570-4123-9a4b-50663ff65924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48913637-6ede-4248-9948-b1d6c707a723", "tag": "c214090d-afaf-4615-bb98-9180de1ac484"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:32.508700 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4efcf1fb-4f8e-4a0a-bad8-1d22bf3af16d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:32.512913 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-a8d00c6f-2acc-4765-8ad0-c591439d1302 req-2d1903c4-a570-4123-9a4b-50663ff65924 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:32.513612 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-a8d00c6f-2acc-4765-8ad0-c591439d1302 req-2d1903c4-a570-4123-9a4b-50663ff65924 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:32.514035 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-a8d00c6f-2acc-4765-8ad0-c591439d1302 req-2d1903c4-a570-4123-9a4b-50663ff65924 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:32.517468 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4efcf1fb-4f8e-4a0a-bad8-1d22bf3af16d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1363 microversion: 2.1 time: 0.159159 Sep 09 21:32:32.518042 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 337/658] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:32 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:32.522872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-98066433-6b93-496e-b67e-8ca798c3bbd0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:32.523461 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-98066433-6b93-496e-b67e-8ca798c3bbd0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:32.526066 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-a8d00c6f-2acc-4765-8ad0-c591439d1302 req-2d1903c4-a570-4123-9a4b-50663ff65924 service nova] Creating event network-changed:c214090d-afaf-4615-bb98-9180de1ac484 for instance 48913637-6ede-4248-9948-b1d6c707a723 on hv-cinder-85221 Sep 09 21:32:32.532255 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-98066433-6b93-496e-b67e-8ca798c3bbd0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:32.532752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-98066433-6b93-496e-b67e-8ca798c3bbd0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:32.533033 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-a8d00c6f-2acc-4765-8ad0-c591439d1302 req-2d1903c4-a570-4123-9a4b-50663ff65924 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041969 Sep 09 21:32:32.534112 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 322/659] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:32:32.534248 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-98066433-6b93-496e-b67e-8ca798c3bbd0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:32.535010 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-98066433-6b93-496e-b67e-8ca798c3bbd0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:32.535503 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-98066433-6b93-496e-b67e-8ca798c3bbd0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:32.535962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-98066433-6b93-496e-b67e-8ca798c3bbd0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:32.566600 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-98066433-6b93-496e-b67e-8ca798c3bbd0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120465) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 21:32:32.631409 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-98066433-6b93-496e-b67e-8ca798c3bbd0 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "POST /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5/action" status: 202 len: 0 microversion: 2.1 time: 0.112314 Sep 09 21:32:32.632145 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 338/660] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:32:32 2022] POST /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:32:32.649729 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-cc3b1707-4257-4e55-b9ef-856b8a88c9d5 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:32.650427 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-cc3b1707-4257-4e55-b9ef-856b8a88c9d5 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:32.658500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc3b1707-4257-4e55-b9ef-856b8a88c9d5 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:32.659075 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc3b1707-4257-4e55-b9ef-856b8a88c9d5 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:32.659695 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc3b1707-4257-4e55-b9ef-856b8a88c9d5 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:32.660420 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc3b1707-4257-4e55-b9ef-856b8a88c9d5 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:32.661016 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc3b1707-4257-4e55-b9ef-856b8a88c9d5 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:32.661521 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cc3b1707-4257-4e55-b9ef-856b8a88c9d5 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:32.667915 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=100 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:33.149964 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-cc3b1707-4257-4e55-b9ef-856b8a88c9d5 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:33.158942 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-cc3b1707-4257-4e55-b9ef-856b8a88c9d5 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1515 microversion: 2.1 time: 0.515198 Sep 09 21:32:33.159666 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 323/661] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:32 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1515 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:33.415945 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-380b9a11-f5cb-421d-a499-58c439f5d6d8 req-601d4500-54f0-4c67-8875-3ff1616cba7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0a8dd3-202a-407d-ae71-aab47f86d6f5", "name": "network-vif-unplugged", "status": "completed", "tag": "7a98c16e-6360-4bb7-9f82-5a8d9091e05f"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:33.426930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-380b9a11-f5cb-421d-a499-58c439f5d6d8 req-601d4500-54f0-4c67-8875-3ff1616cba7e service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:33.427422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-380b9a11-f5cb-421d-a499-58c439f5d6d8 req-601d4500-54f0-4c67-8875-3ff1616cba7e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:33.428040 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-380b9a11-f5cb-421d-a499-58c439f5d6d8 req-601d4500-54f0-4c67-8875-3ff1616cba7e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:33.439657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.compute.server_external_events [req-380b9a11-f5cb-421d-a499-58c439f5d6d8 req-601d4500-54f0-4c67-8875-3ff1616cba7e service nova] Unable to find a host for instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5. Dropping event network-vif-unplugged {{(pid=120465) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 21:32:33.440529 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-380b9a11-f5cb-421d-a499-58c439f5d6d8 req-601d4500-54f0-4c67-8875-3ff1616cba7e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028864 Sep 09 21:32:33.441103 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 339/662] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 21:32:33.542188 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c0dfb1df-f5f3-4ceb-9ea3-72a75e9b5f0d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:33.542806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c0dfb1df-f5f3-4ceb-9ea3-72a75e9b5f0d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:33.549177 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c0dfb1df-f5f3-4ceb-9ea3-72a75e9b5f0d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:33.549670 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c0dfb1df-f5f3-4ceb-9ea3-72a75e9b5f0d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:33.550110 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c0dfb1df-f5f3-4ceb-9ea3-72a75e9b5f0d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:33.550799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c0dfb1df-f5f3-4ceb-9ea3-72a75e9b5f0d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:33.551290 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c0dfb1df-f5f3-4ceb-9ea3-72a75e9b5f0d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:33.551758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c0dfb1df-f5f3-4ceb-9ea3-72a75e9b5f0d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:33.682398 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c0dfb1df-f5f3-4ceb-9ea3-72a75e9b5f0d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:33.690169 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c0dfb1df-f5f3-4ceb-9ea3-72a75e9b5f0d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1363 microversion: 2.1 time: 0.151829 Sep 09 21:32:33.690732 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 324/663] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:33 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:34.182284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1bcf6ca6-ab8b-4341-9148-37f1a6b1d85b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:34.182891 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1bcf6ca6-ab8b-4341-9148-37f1a6b1d85b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:34.188895 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1bcf6ca6-ab8b-4341-9148-37f1a6b1d85b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:34.189378 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1bcf6ca6-ab8b-4341-9148-37f1a6b1d85b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:34.189813 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1bcf6ca6-ab8b-4341-9148-37f1a6b1d85b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:34.190496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1bcf6ca6-ab8b-4341-9148-37f1a6b1d85b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:34.190953 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1bcf6ca6-ab8b-4341-9148-37f1a6b1d85b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:34.191379 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1bcf6ca6-ab8b-4341-9148-37f1a6b1d85b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:34.323784 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1bcf6ca6-ab8b-4341-9148-37f1a6b1d85b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:34.332195 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1bcf6ca6-ab8b-4341-9148-37f1a6b1d85b tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1515 microversion: 2.1 time: 0.153849 Sep 09 21:32:34.332750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 340/664] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:34 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:34.713202 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d8f67cdf-0920-4c97-9fc9-65de082ba93e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:34.713811 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d8f67cdf-0920-4c97-9fc9-65de082ba93e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:34.720772 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d8f67cdf-0920-4c97-9fc9-65de082ba93e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:34.721250 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d8f67cdf-0920-4c97-9fc9-65de082ba93e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:34.721681 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d8f67cdf-0920-4c97-9fc9-65de082ba93e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:34.722357 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d8f67cdf-0920-4c97-9fc9-65de082ba93e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:34.722813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d8f67cdf-0920-4c97-9fc9-65de082ba93e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:34.723240 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d8f67cdf-0920-4c97-9fc9-65de082ba93e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:34.852662 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d8f67cdf-0920-4c97-9fc9-65de082ba93e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:34.860255 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d8f67cdf-0920-4c97-9fc9-65de082ba93e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1363 microversion: 2.1 time: 0.150892 Sep 09 21:32:34.861096 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 325/665] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:34 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:35.355906 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a9f447fc-e57c-4c27-9c5d-403acc6d5ce8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:35.357062 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a9f447fc-e57c-4c27-9c5d-403acc6d5ce8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:35.363361 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a9f447fc-e57c-4c27-9c5d-403acc6d5ce8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:35.363945 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a9f447fc-e57c-4c27-9c5d-403acc6d5ce8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:35.364379 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a9f447fc-e57c-4c27-9c5d-403acc6d5ce8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:35.365059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a9f447fc-e57c-4c27-9c5d-403acc6d5ce8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:35.365780 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a9f447fc-e57c-4c27-9c5d-403acc6d5ce8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:35.366203 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a9f447fc-e57c-4c27-9c5d-403acc6d5ce8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:35.493535 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a9f447fc-e57c-4c27-9c5d-403acc6d5ce8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:35.501851 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a9f447fc-e57c-4c27-9c5d-403acc6d5ce8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1515 microversion: 2.1 time: 0.149999 Sep 09 21:32:35.502402 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 341/666] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:35 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:35.884240 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ee2e6fda-837e-4642-b670-2384b4ec7f46 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:35.884978 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ee2e6fda-837e-4642-b670-2384b4ec7f46 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:35.891851 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee2e6fda-837e-4642-b670-2384b4ec7f46 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:35.892382 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee2e6fda-837e-4642-b670-2384b4ec7f46 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:35.892913 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee2e6fda-837e-4642-b670-2384b4ec7f46 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:35.893706 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee2e6fda-837e-4642-b670-2384b4ec7f46 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:35.894259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee2e6fda-837e-4642-b670-2384b4ec7f46 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:35.894781 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee2e6fda-837e-4642-b670-2384b4ec7f46 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:36.143602 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ee2e6fda-837e-4642-b670-2384b4ec7f46 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:36.151133 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ee2e6fda-837e-4642-b670-2384b4ec7f46 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1363 microversion: 2.1 time: 0.271022 Sep 09 21:32:36.151831 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 326/667] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:35 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:36.523974 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-082aaaca-e637-4b24-a1b4-45a229bc1cbd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:36.524581 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-082aaaca-e637-4b24-a1b4-45a229bc1cbd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:36.531014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-082aaaca-e637-4b24-a1b4-45a229bc1cbd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:36.531799 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-082aaaca-e637-4b24-a1b4-45a229bc1cbd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:36.532561 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-082aaaca-e637-4b24-a1b4-45a229bc1cbd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:36.534499 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-082aaaca-e637-4b24-a1b4-45a229bc1cbd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:36.534968 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-082aaaca-e637-4b24-a1b4-45a229bc1cbd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:36.535391 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-082aaaca-e637-4b24-a1b4-45a229bc1cbd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:36.676658 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-082aaaca-e637-4b24-a1b4-45a229bc1cbd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:36.685011 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-082aaaca-e637-4b24-a1b4-45a229bc1cbd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1517 microversion: 2.1 time: 0.164851 Sep 09 21:32:36.685699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 342/668] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:36 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:37.174391 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-eb7f7a77-ffb4-4703-9023-c73ae63519ce tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:37.175128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-eb7f7a77-ffb4-4703-9023-c73ae63519ce tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:37.181575 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb7f7a77-ffb4-4703-9023-c73ae63519ce tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:37.182072 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb7f7a77-ffb4-4703-9023-c73ae63519ce tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:37.182514 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb7f7a77-ffb4-4703-9023-c73ae63519ce tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:37.183213 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb7f7a77-ffb4-4703-9023-c73ae63519ce tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:37.183704 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb7f7a77-ffb4-4703-9023-c73ae63519ce tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:37.184138 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb7f7a77-ffb4-4703-9023-c73ae63519ce tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:37.396250 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-eb7f7a77-ffb4-4703-9023-c73ae63519ce tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:37.403798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-eb7f7a77-ffb4-4703-9023-c73ae63519ce tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1363 microversion: 2.1 time: 0.233265 Sep 09 21:32:37.405151 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 327/669] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:37 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:37.709061 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-44925578-54eb-4b71-be1f-0c94e6000ecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:37.709726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-44925578-54eb-4b71-be1f-0c94e6000ecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:37.716236 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44925578-54eb-4b71-be1f-0c94e6000ecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:37.716726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44925578-54eb-4b71-be1f-0c94e6000ecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:37.717210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44925578-54eb-4b71-be1f-0c94e6000ecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:37.717918 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44925578-54eb-4b71-be1f-0c94e6000ecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:37.718354 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44925578-54eb-4b71-be1f-0c94e6000ecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:37.718776 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44925578-54eb-4b71-be1f-0c94e6000ecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:37.848853 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-44925578-54eb-4b71-be1f-0c94e6000ecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:37.856749 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-44925578-54eb-4b71-be1f-0c94e6000ecd tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1573 microversion: 2.1 time: 0.151574 Sep 09 21:32:37.857319 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 343/670] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:37 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:38.427341 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-981f9390-53e0-47dc-819a-f95f777608fc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:38.427971 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-981f9390-53e0-47dc-819a-f95f777608fc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:38.429787 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:38.430551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:38.437631 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-981f9390-53e0-47dc-819a-f95f777608fc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:38.438117 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-981f9390-53e0-47dc-819a-f95f777608fc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:38.438555 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-981f9390-53e0-47dc-819a-f95f777608fc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:38.439242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-981f9390-53e0-47dc-819a-f95f777608fc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:38.439735 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-981f9390-53e0-47dc-819a-f95f777608fc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:38.440166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-981f9390-53e0-47dc-819a-f95f777608fc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:38.567836 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-981f9390-53e0-47dc-819a-f95f777608fc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:38.575253 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-981f9390-53e0-47dc-819a-f95f777608fc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1363 microversion: 2.1 time: 0.151870 Sep 09 21:32:38.575845 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 328/671] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:38 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:38.880809 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-081b5351-e365-4094-8a90-d39fff92da91 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:38.881320 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-081b5351-e365-4094-8a90-d39fff92da91 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:38.883120 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=6 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:38.888742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081b5351-e365-4094-8a90-d39fff92da91 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:38.889805 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081b5351-e365-4094-8a90-d39fff92da91 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:38.890241 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081b5351-e365-4094-8a90-d39fff92da91 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:38.890930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081b5351-e365-4094-8a90-d39fff92da91 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:38.891389 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081b5351-e365-4094-8a90-d39fff92da91 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:38.891841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081b5351-e365-4094-8a90-d39fff92da91 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:39.265966 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-081b5351-e365-4094-8a90-d39fff92da91 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:39.273560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-081b5351-e365-4094-8a90-d39fff92da91 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1573 microversion: 2.1 time: 0.396747 Sep 09 21:32:39.274133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 344/672] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:38 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1573 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:39.501283 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-bd819e8c-737d-4531-9abc-896147fa70c4 req-0706ad73-b68d-4df8-9abb-ab46e58c2819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48913637-6ede-4248-9948-b1d6c707a723", "name": "network-vif-plugged", "status": "completed", "tag": "c214090d-afaf-4615-bb98-9180de1ac484"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:39.513714 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-bd819e8c-737d-4531-9abc-896147fa70c4 req-0706ad73-b68d-4df8-9abb-ab46e58c2819 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:39.514920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-bd819e8c-737d-4531-9abc-896147fa70c4 req-0706ad73-b68d-4df8-9abb-ab46e58c2819 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:39.515350 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-bd819e8c-737d-4531-9abc-896147fa70c4 req-0706ad73-b68d-4df8-9abb-ab46e58c2819 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:39.526476 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-bd819e8c-737d-4531-9abc-896147fa70c4 req-0706ad73-b68d-4df8-9abb-ab46e58c2819 service nova] Creating event network-vif-plugged:c214090d-afaf-4615-bb98-9180de1ac484 for instance 48913637-6ede-4248-9948-b1d6c707a723 on hv-cinder-85221 Sep 09 21:32:39.532746 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-bd819e8c-737d-4531-9abc-896147fa70c4 req-0706ad73-b68d-4df8-9abb-ab46e58c2819 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035526 Sep 09 21:32:39.533334 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 329/673] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:32:39.598303 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1987e81e-4703-4aba-909e-4fa9d70fadf9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:39.598915 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1987e81e-4703-4aba-909e-4fa9d70fadf9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:39.604878 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1987e81e-4703-4aba-909e-4fa9d70fadf9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:39.605369 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1987e81e-4703-4aba-909e-4fa9d70fadf9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:39.605811 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1987e81e-4703-4aba-909e-4fa9d70fadf9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:39.606508 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1987e81e-4703-4aba-909e-4fa9d70fadf9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:39.606969 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1987e81e-4703-4aba-909e-4fa9d70fadf9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:39.607398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1987e81e-4703-4aba-909e-4fa9d70fadf9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:39.743573 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1987e81e-4703-4aba-909e-4fa9d70fadf9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:39.751792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1987e81e-4703-4aba-909e-4fa9d70fadf9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1363 microversion: 2.1 time: 0.157350 Sep 09 21:32:39.752358 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 345/674] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:39 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:40.297610 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a8421510-f05e-4543-b255-a18acd452421 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:40.298303 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a8421510-f05e-4543-b255-a18acd452421 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:40.304406 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8421510-f05e-4543-b255-a18acd452421 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:40.304884 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8421510-f05e-4543-b255-a18acd452421 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:40.305313 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8421510-f05e-4543-b255-a18acd452421 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:40.305988 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8421510-f05e-4543-b255-a18acd452421 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:40.306440 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8421510-f05e-4543-b255-a18acd452421 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:40.306861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a8421510-f05e-4543-b255-a18acd452421 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:40.435498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a8421510-f05e-4543-b255-a18acd452421 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:40.443129 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a8421510-f05e-4543-b255-a18acd452421 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1573 microversion: 2.1 time: 0.150802 Sep 09 21:32:40.443717 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 330/675] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:40 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:40.775223 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6b013278-3a99-4a05-9d8c-bb9059ac3818 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:40.775784 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6b013278-3a99-4a05-9d8c-bb9059ac3818 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:40.783052 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b013278-3a99-4a05-9d8c-bb9059ac3818 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:40.783595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b013278-3a99-4a05-9d8c-bb9059ac3818 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:40.784176 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b013278-3a99-4a05-9d8c-bb9059ac3818 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:40.784727 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b013278-3a99-4a05-9d8c-bb9059ac3818 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:40.785192 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b013278-3a99-4a05-9d8c-bb9059ac3818 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:40.785624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6b013278-3a99-4a05-9d8c-bb9059ac3818 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:40.915681 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6b013278-3a99-4a05-9d8c-bb9059ac3818 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:40.923502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6b013278-3a99-4a05-9d8c-bb9059ac3818 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1363 microversion: 2.1 time: 0.152181 Sep 09 21:32:40.924076 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 346/676] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:40 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:41.465960 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-438b674e-abbf-4a2c-891a-c009da16a432 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:41.466566 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-438b674e-abbf-4a2c-891a-c009da16a432 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:41.473119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-438b674e-abbf-4a2c-891a-c009da16a432 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:41.473599 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-438b674e-abbf-4a2c-891a-c009da16a432 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:41.474029 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-438b674e-abbf-4a2c-891a-c009da16a432 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:41.474704 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-438b674e-abbf-4a2c-891a-c009da16a432 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:41.475154 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-438b674e-abbf-4a2c-891a-c009da16a432 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:41.475602 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-438b674e-abbf-4a2c-891a-c009da16a432 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:41.605480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-438b674e-abbf-4a2c-891a-c009da16a432 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:41.613777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-438b674e-abbf-4a2c-891a-c009da16a432 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1573 microversion: 2.1 time: 0.151586 Sep 09 21:32:41.614348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 331/677] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:41 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:41.946281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-47bf2ccb-9de7-467d-b7ca-a4b85e2a470d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:41.946886 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-47bf2ccb-9de7-467d-b7ca-a4b85e2a470d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:41.953321 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-47bf2ccb-9de7-467d-b7ca-a4b85e2a470d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:41.953822 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-47bf2ccb-9de7-467d-b7ca-a4b85e2a470d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:41.954251 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-47bf2ccb-9de7-467d-b7ca-a4b85e2a470d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:41.954935 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-47bf2ccb-9de7-467d-b7ca-a4b85e2a470d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:41.955387 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-47bf2ccb-9de7-467d-b7ca-a4b85e2a470d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:41.955838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-47bf2ccb-9de7-467d-b7ca-a4b85e2a470d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:42.084148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-47bf2ccb-9de7-467d-b7ca-a4b85e2a470d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:42.091672 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-47bf2ccb-9de7-467d-b7ca-a4b85e2a470d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1550 microversion: 2.1 time: 0.149182 Sep 09 21:32:42.092731 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 347/678] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:41 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:32:42.115380 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6846b3a4-2a3f-4e2a-a48e-12e862d37395 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:42.115966 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6846b3a4-2a3f-4e2a-a48e-12e862d37395 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:42.121728 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6846b3a4-2a3f-4e2a-a48e-12e862d37395 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:42.122212 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6846b3a4-2a3f-4e2a-a48e-12e862d37395 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:42.122645 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6846b3a4-2a3f-4e2a-a48e-12e862d37395 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:42.123328 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6846b3a4-2a3f-4e2a-a48e-12e862d37395 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:42.123802 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6846b3a4-2a3f-4e2a-a48e-12e862d37395 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:42.124218 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6846b3a4-2a3f-4e2a-a48e-12e862d37395 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:42.204227 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6846b3a4-2a3f-4e2a-a48e-12e862d37395 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092588 Sep 09 21:32:42.204826 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 332/679] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 21:32:42 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:32:42.641092 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a6d27f77-68a2-48c7-a8cc-f59fcfb2a669 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:42.641825 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a6d27f77-68a2-48c7-a8cc-f59fcfb2a669 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:42.647941 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6d27f77-68a2-48c7-a8cc-f59fcfb2a669 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:42.648437 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6d27f77-68a2-48c7-a8cc-f59fcfb2a669 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:42.648877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6d27f77-68a2-48c7-a8cc-f59fcfb2a669 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:42.649567 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6d27f77-68a2-48c7-a8cc-f59fcfb2a669 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:42.650027 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6d27f77-68a2-48c7-a8cc-f59fcfb2a669 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:42.650473 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a6d27f77-68a2-48c7-a8cc-f59fcfb2a669 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:42.786039 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a6d27f77-68a2-48c7-a8cc-f59fcfb2a669 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:42.793739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a6d27f77-68a2-48c7-a8cc-f59fcfb2a669 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1573 microversion: 2.1 time: 0.157271 Sep 09 21:32:42.794303 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 348/680] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:42 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:32:43.144279 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-435596d6-263e-4e16-bbac-59c51ae2ff35 req-44ddf026-a411-422b-a96c-5e40230e53e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48913637-6ede-4248-9948-b1d6c707a723", "tag": "c214090d-afaf-4615-bb98-9180de1ac484"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:43.154142 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-435596d6-263e-4e16-bbac-59c51ae2ff35 req-44ddf026-a411-422b-a96c-5e40230e53e1 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:43.154778 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-435596d6-263e-4e16-bbac-59c51ae2ff35 req-44ddf026-a411-422b-a96c-5e40230e53e1 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:43.155240 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-435596d6-263e-4e16-bbac-59c51ae2ff35 req-44ddf026-a411-422b-a96c-5e40230e53e1 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:43.166387 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-435596d6-263e-4e16-bbac-59c51ae2ff35 req-44ddf026-a411-422b-a96c-5e40230e53e1 service nova] Creating event network-changed:c214090d-afaf-4615-bb98-9180de1ac484 for instance 48913637-6ede-4248-9948-b1d6c707a723 on hv-cinder-85221 Sep 09 21:32:43.171775 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-435596d6-263e-4e16-bbac-59c51ae2ff35 req-44ddf026-a411-422b-a96c-5e40230e53e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031713 Sep 09 21:32:43.172383 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 333/681] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:32:43.818527 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ae52c5bf-3357-4ea4-a6b7-490f67ae4d7f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:43.819147 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ae52c5bf-3357-4ea4-a6b7-490f67ae4d7f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:43.825461 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ae52c5bf-3357-4ea4-a6b7-490f67ae4d7f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:43.826039 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ae52c5bf-3357-4ea4-a6b7-490f67ae4d7f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:43.827127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ae52c5bf-3357-4ea4-a6b7-490f67ae4d7f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:43.828010 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ae52c5bf-3357-4ea4-a6b7-490f67ae4d7f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:43.828543 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ae52c5bf-3357-4ea4-a6b7-490f67ae4d7f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:43.829032 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ae52c5bf-3357-4ea4-a6b7-490f67ae4d7f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:43.989390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ae52c5bf-3357-4ea4-a6b7-490f67ae4d7f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:43.997293 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ae52c5bf-3357-4ea4-a6b7-490f67ae4d7f tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1573 microversion: 2.1 time: 0.183804 Sep 09 21:32:43.999846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 349/682] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:43 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1573 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:45.028356 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-56a65c61-b538-40e6-a6f7-9dba485f27f1 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:45.029089 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-56a65c61-b538-40e6-a6f7-9dba485f27f1 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:45.036241 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56a65c61-b538-40e6-a6f7-9dba485f27f1 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:45.036729 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56a65c61-b538-40e6-a6f7-9dba485f27f1 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:45.037161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56a65c61-b538-40e6-a6f7-9dba485f27f1 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:45.037844 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56a65c61-b538-40e6-a6f7-9dba485f27f1 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:45.038295 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56a65c61-b538-40e6-a6f7-9dba485f27f1 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:45.038715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56a65c61-b538-40e6-a6f7-9dba485f27f1 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:45.173227 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-56a65c61-b538-40e6-a6f7-9dba485f27f1 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:45.181050 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-56a65c61-b538-40e6-a6f7-9dba485f27f1 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1573 microversion: 2.1 time: 0.157430 Sep 09 21:32:45.181614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 334/683] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:45 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:46.203678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4c22d375-22d0-4661-9875-00884b628be8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:46.204882 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4c22d375-22d0-4661-9875-00884b628be8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:46.211270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c22d375-22d0-4661-9875-00884b628be8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:46.212005 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c22d375-22d0-4661-9875-00884b628be8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:46.212301 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c22d375-22d0-4661-9875-00884b628be8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:46.212997 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c22d375-22d0-4661-9875-00884b628be8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:46.213453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c22d375-22d0-4661-9875-00884b628be8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:46.213883 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4c22d375-22d0-4661-9875-00884b628be8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:46.345252 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4c22d375-22d0-4661-9875-00884b628be8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:46.352843 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4c22d375-22d0-4661-9875-00884b628be8 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1573 microversion: 2.1 time: 0.153054 Sep 09 21:32:46.353399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 350/684] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:46 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:47.377354 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a19a1815-354a-43fe-b63a-27aa9d28c97c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:47.377972 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a19a1815-354a-43fe-b63a-27aa9d28c97c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:47.384405 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a19a1815-354a-43fe-b63a-27aa9d28c97c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:47.384893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a19a1815-354a-43fe-b63a-27aa9d28c97c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:47.385332 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a19a1815-354a-43fe-b63a-27aa9d28c97c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:47.386014 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a19a1815-354a-43fe-b63a-27aa9d28c97c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:47.386470 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a19a1815-354a-43fe-b63a-27aa9d28c97c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:47.386893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a19a1815-354a-43fe-b63a-27aa9d28c97c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:47.523909 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a19a1815-354a-43fe-b63a-27aa9d28c97c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:47.531846 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a19a1815-354a-43fe-b63a-27aa9d28c97c tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1573 microversion: 2.1 time: 0.158665 Sep 09 21:32:47.532648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 335/685] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:47 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:47.562865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-db36dd8a-341d-479b-a2ec-139ea03aead5 req-1736384e-801e-46f2-84e0-a938902883c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0a8dd3-202a-407d-ae71-aab47f86d6f5", "name": "network-vif-plugged", "status": "completed", "tag": "7a98c16e-6360-4bb7-9f82-5a8d9091e05f"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:47.573202 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-db36dd8a-341d-479b-a2ec-139ea03aead5 req-1736384e-801e-46f2-84e0-a938902883c4 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:47.573785 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-db36dd8a-341d-479b-a2ec-139ea03aead5 req-1736384e-801e-46f2-84e0-a938902883c4 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:47.574239 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-db36dd8a-341d-479b-a2ec-139ea03aead5 req-1736384e-801e-46f2-84e0-a938902883c4 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:47.584923 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-db36dd8a-341d-479b-a2ec-139ea03aead5 req-1736384e-801e-46f2-84e0-a938902883c4 service nova] Creating event network-vif-plugged:7a98c16e-6360-4bb7-9f82-5a8d9091e05f for instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 on hv-cinder-85221 Sep 09 21:32:47.589754 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-db36dd8a-341d-479b-a2ec-139ea03aead5 req-1736384e-801e-46f2-84e0-a938902883c4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031273 Sep 09 21:32:47.590325 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 351/686] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:32:48.559431 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6c8d51a8-4e38-432f-85a2-c367a0026d63 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:48.560082 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6c8d51a8-4e38-432f-85a2-c367a0026d63 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:48.567912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c8d51a8-4e38-432f-85a2-c367a0026d63 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:48.568410 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c8d51a8-4e38-432f-85a2-c367a0026d63 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:48.568852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c8d51a8-4e38-432f-85a2-c367a0026d63 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:48.569562 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c8d51a8-4e38-432f-85a2-c367a0026d63 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:48.570022 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c8d51a8-4e38-432f-85a2-c367a0026d63 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:48.570455 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c8d51a8-4e38-432f-85a2-c367a0026d63 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:48.634908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-156e0093-dada-45ce-b888-2f991e6c229d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:48.635634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-156e0093-dada-45ce-b888-2f991e6c229d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:48.643510 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-156e0093-dada-45ce-b888-2f991e6c229d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:48.644168 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-156e0093-dada-45ce-b888-2f991e6c229d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:48.644683 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-156e0093-dada-45ce-b888-2f991e6c229d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:48.645457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-156e0093-dada-45ce-b888-2f991e6c229d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:48.646019 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-156e0093-dada-45ce-b888-2f991e6c229d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:48.646551 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-156e0093-dada-45ce-b888-2f991e6c229d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:48.650538 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:48.704810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6c8d51a8-4e38-432f-85a2-c367a0026d63 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:48.712866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6c8d51a8-4e38-432f-85a2-c367a0026d63 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1573 microversion: 2.1 time: 0.157276 Sep 09 21:32:48.713744 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 336/687] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:48 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:48.731813 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-156e0093-dada-45ce-b888-2f991e6c229d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lazy-loading 'services' on Instance uuid 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:32:48.802330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-156e0093-dada-45ce-b888-2f991e6c229d tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "DELETE /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments/549d0545-6dfe-4767-aab7-0c3ca11939bb" status: 202 len: 0 microversion: 2.1 time: 0.172043 Sep 09 21:32:48.802913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 352/688] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:32:48 2022] DELETE /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments/549d0545-6dfe-4767-aab7-0c3ca11939bb => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 21:32:48.811680 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2fe75ce1-69ec-44e9-851c-95aeb889760c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:48.813825 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2fe75ce1-69ec-44e9-851c-95aeb889760c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:48.819784 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce1-69ec-44e9-851c-95aeb889760c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:48.820428 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce1-69ec-44e9-851c-95aeb889760c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:48.820869 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce1-69ec-44e9-851c-95aeb889760c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:48.821558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce1-69ec-44e9-851c-95aeb889760c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:48.822016 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce1-69ec-44e9-851c-95aeb889760c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:48.822440 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce1-69ec-44e9-851c-95aeb889760c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:48.851921 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2fe75ce1-69ec-44e9-851c-95aeb889760c tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044651 Sep 09 21:32:48.852480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 337/689] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:32:48 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:32:49.736954 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e6c21c6b-b551-47f7-aa28-8edff301b0af tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:49.737653 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e6c21c6b-b551-47f7-aa28-8edff301b0af tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:49.744410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e6c21c6b-b551-47f7-aa28-8edff301b0af tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:49.744897 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e6c21c6b-b551-47f7-aa28-8edff301b0af tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:49.745334 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e6c21c6b-b551-47f7-aa28-8edff301b0af tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:49.746021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e6c21c6b-b551-47f7-aa28-8edff301b0af tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:49.746479 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e6c21c6b-b551-47f7-aa28-8edff301b0af tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:49.746907 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e6c21c6b-b551-47f7-aa28-8edff301b0af tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:49.864332 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-eb073fef-63f0-4feb-b4e5-6a97429b0c03 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:49.866511 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-eb073fef-63f0-4feb-b4e5-6a97429b0c03 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:49.872553 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb073fef-63f0-4feb-b4e5-6a97429b0c03 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:49.873089 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb073fef-63f0-4feb-b4e5-6a97429b0c03 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:49.873528 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb073fef-63f0-4feb-b4e5-6a97429b0c03 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:49.874208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb073fef-63f0-4feb-b4e5-6a97429b0c03 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:49.874656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb073fef-63f0-4feb-b4e5-6a97429b0c03 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:49.875085 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eb073fef-63f0-4feb-b4e5-6a97429b0c03 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:49.881328 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e6c21c6b-b551-47f7-aa28-8edff301b0af tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:49.889753 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e6c21c6b-b551-47f7-aa28-8edff301b0af tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1560 microversion: 2.1 time: 0.156781 Sep 09 21:32:49.890231 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 353/690] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:49 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:49.905126 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-eb073fef-63f0-4feb-b4e5-6a97429b0c03 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044087 Sep 09 21:32:49.905793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 338/691] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:32:49 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:32:50.917105 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9bbd5cc2-36f7-4448-b410-96030c595a21 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:50.919334 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9bbd5cc2-36f7-4448-b410-96030c595a21 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:50.926350 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bbd5cc2-36f7-4448-b410-96030c595a21 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:50.926824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bbd5cc2-36f7-4448-b410-96030c595a21 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:50.927256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bbd5cc2-36f7-4448-b410-96030c595a21 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:50.927960 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bbd5cc2-36f7-4448-b410-96030c595a21 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:50.928447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bbd5cc2-36f7-4448-b410-96030c595a21 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:50.928872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9bbd5cc2-36f7-4448-b410-96030c595a21 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:50.956560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9bbd5cc2-36f7-4448-b410-96030c595a21 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043458 Sep 09 21:32:50.957100 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 354/692] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:32:50 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:32:51.034545 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a13a088c-1ee0-4152-a0d0-107643c97bb8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:51.035058 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a13a088c-1ee0-4152-a0d0-107643c97bb8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:51.041406 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a13a088c-1ee0-4152-a0d0-107643c97bb8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:51.041896 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a13a088c-1ee0-4152-a0d0-107643c97bb8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:51.042337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a13a088c-1ee0-4152-a0d0-107643c97bb8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:51.043026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a13a088c-1ee0-4152-a0d0-107643c97bb8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:51.043482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a13a088c-1ee0-4152-a0d0-107643c97bb8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:51.044010 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a13a088c-1ee0-4152-a0d0-107643c97bb8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:51.069500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a13a088c-1ee0-4152-a0d0-107643c97bb8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:32:51.119798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:32:51.148799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a13a088c-1ee0-4152-a0d0-107643c97bb8 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "DELETE /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 204 len: 0 microversion: 2.1 time: 0.117991 Sep 09 21:32:51.149386 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 339/693] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:32:51 2022] DELETE /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:32:51.158524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-038fc44e-96f0-4bba-bf57-256d574684d6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:51.159125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-038fc44e-96f0-4bba-bf57-256d574684d6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:51.164927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-038fc44e-96f0-4bba-bf57-256d574684d6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:51.165405 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-038fc44e-96f0-4bba-bf57-256d574684d6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:51.165838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-038fc44e-96f0-4bba-bf57-256d574684d6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:51.166509 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-038fc44e-96f0-4bba-bf57-256d574684d6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:51.166961 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-038fc44e-96f0-4bba-bf57-256d574684d6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:51.167432 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-038fc44e-96f0-4bba-bf57-256d574684d6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:51.294893 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-038fc44e-96f0-4bba-bf57-256d574684d6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:51.302450 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-038fc44e-96f0-4bba-bf57-256d574684d6 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1689 microversion: 2.1 time: 0.148740 Sep 09 21:32:51.303009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 355/694] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:51 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:52.326037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-663152ac-f8b8-47ad-a56b-10dc502766e2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:52.326736 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-663152ac-f8b8-47ad-a56b-10dc502766e2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:52.333331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-663152ac-f8b8-47ad-a56b-10dc502766e2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:52.333821 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-663152ac-f8b8-47ad-a56b-10dc502766e2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:52.334261 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-663152ac-f8b8-47ad-a56b-10dc502766e2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:52.334946 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-663152ac-f8b8-47ad-a56b-10dc502766e2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:52.335419 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-663152ac-f8b8-47ad-a56b-10dc502766e2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:52.335870 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-663152ac-f8b8-47ad-a56b-10dc502766e2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:52.465350 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-663152ac-f8b8-47ad-a56b-10dc502766e2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:52.473487 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-663152ac-f8b8-47ad-a56b-10dc502766e2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1689 microversion: 2.1 time: 0.151833 Sep 09 21:32:52.474054 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 340/695] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:52 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:53.497065 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ab326a59-6038-4051-8b81-31e8a61f6219 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:53.497681 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ab326a59-6038-4051-8b81-31e8a61f6219 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:53.504837 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab326a59-6038-4051-8b81-31e8a61f6219 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:53.505327 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab326a59-6038-4051-8b81-31e8a61f6219 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:53.505770 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab326a59-6038-4051-8b81-31e8a61f6219 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:53.506453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab326a59-6038-4051-8b81-31e8a61f6219 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:53.506913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab326a59-6038-4051-8b81-31e8a61f6219 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:53.507365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ab326a59-6038-4051-8b81-31e8a61f6219 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:53.637085 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ab326a59-6038-4051-8b81-31e8a61f6219 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:53.644752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ab326a59-6038-4051-8b81-31e8a61f6219 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1689 microversion: 2.1 time: 0.151527 Sep 09 21:32:53.645309 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 356/696] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:53 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:54.668124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ee1930b2-f442-4776-be50-2fb41d97c54e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:54.668774 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ee1930b2-f442-4776-be50-2fb41d97c54e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:54.675478 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee1930b2-f442-4776-be50-2fb41d97c54e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:54.676026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee1930b2-f442-4776-be50-2fb41d97c54e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:54.676466 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee1930b2-f442-4776-be50-2fb41d97c54e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:54.677153 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee1930b2-f442-4776-be50-2fb41d97c54e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:54.677609 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee1930b2-f442-4776-be50-2fb41d97c54e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:54.678036 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ee1930b2-f442-4776-be50-2fb41d97c54e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:54.815302 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ee1930b2-f442-4776-be50-2fb41d97c54e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:54.823025 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ee1930b2-f442-4776-be50-2fb41d97c54e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1689 microversion: 2.1 time: 0.158799 Sep 09 21:32:54.823628 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 341/697] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:54 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:55.846911 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d0c5b307-791c-4ada-9b02-5e5a915de518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:55.847471 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d0c5b307-791c-4ada-9b02-5e5a915de518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:55.855631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0c5b307-791c-4ada-9b02-5e5a915de518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:55.856128 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0c5b307-791c-4ada-9b02-5e5a915de518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:55.856770 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0c5b307-791c-4ada-9b02-5e5a915de518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:55.857345 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0c5b307-791c-4ada-9b02-5e5a915de518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:55.857801 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0c5b307-791c-4ada-9b02-5e5a915de518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:55.858224 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d0c5b307-791c-4ada-9b02-5e5a915de518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:55.868934 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-227a7e2a-6d39-491d-a81c-bb140e35700b req-f31dc857-bc02-457d-9276-6a8adcdcfa51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bb0cf9-68da-449d-bdbd-d8c1aa49dc96", "name": "network-vif-deleted", "tag": "9163f46b-8a4c-44b4-a67e-f7a360441df7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:32:55.880634 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-227a7e2a-6d39-491d-a81c-bb140e35700b req-f31dc857-bc02-457d-9276-6a8adcdcfa51 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:55.881739 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-227a7e2a-6d39-491d-a81c-bb140e35700b req-f31dc857-bc02-457d-9276-6a8adcdcfa51 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:55.882182 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-227a7e2a-6d39-491d-a81c-bb140e35700b req-f31dc857-bc02-457d-9276-6a8adcdcfa51 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:55.895021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-227a7e2a-6d39-491d-a81c-bb140e35700b req-f31dc857-bc02-457d-9276-6a8adcdcfa51 service nova] Creating event network-vif-deleted:9163f46b-8a4c-44b4-a67e-f7a360441df7 for instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 on hv-cinder-85221 Sep 09 21:32:55.900329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-227a7e2a-6d39-491d-a81c-bb140e35700b req-f31dc857-bc02-457d-9276-6a8adcdcfa51 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036346 Sep 09 21:32:55.901087 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 342/698] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:32:55.936605 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d0c5b307-791c-4ada-9b02-5e5a915de518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:32:55.946126 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d0c5b307-791c-4ada-9b02-5e5a915de518 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 200 len: 1621 microversion: 2.1 time: 0.103628 Sep 09 21:32:55.959573 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 357/699] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:55 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 1621 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:32:56.971784 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:56.972640 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:32:56.978720 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:56.979211 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:56.979676 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:56.980370 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:32:56.980829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:32:56.981259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:32:56.997083 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] HTTP exception thrown: Instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 could not be found. Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Request method failure captured: Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 HTTP/1.1 Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG6-hYeoA0KilbcouWpERZ9YtQ82F_IJMypUZNsqF-LHQO0jXBghrw_akyfPTZ9RfD5QZsUC56WPkMWHPye2TMrxCBvzQNtqia3kTLk6srJ6joD45wfLdTCle-w3LQa2RNfPLhaz2Ly1gmO4Nr9NiDeNh0DEz2qj6shMAQnL2Zfug0yo Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 5472cdfe59524ac5b826fba54758c68f Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:32:56.998665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5472cdfe59524ac5b826fba54758c68f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5472cdfe59524ac5b826fba54758c68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5472cdfe59524ac5b826fba54758c68f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5472cdfe59524ac5b826fba54758c68f"}]}] Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 5472cdfe59524ac5b826fba54758c68f Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-ServerRescueNegativeTestJSON-1311387682-project Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 0d773c7f6aca4ea2ad2872f67e9116af Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311387682-project Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 could not be found. Sep 09 21:32:57.000281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '99bb0cf9-68da-449d-bdbd-d8c1aa49dc96'} Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 could not be found. Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:32:57.001262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 could not be found. Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 could not be found. Sep 09 21:32:57.002534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:32:57.004122 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Returning 404 to user: Instance 99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:32:57.004122 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3a2a52c7-5068-4a38-80a2-ef99149c054f tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96" status: 404 len: 111 microversion: 2.1 time: 0.033550 Sep 09 21:32:57.004122 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 343/700] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:32:56 2022] GET /compute/v2.1/servers/99bb0cf9-68da-449d-bdbd-d8c1aa49dc96 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:32:57.008654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f007efe2-b6ae-4abe-a9ed-2daa65e7138b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '.version_select at 0x7f08166c3b80>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:32:57.028111 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f007efe2-b6ae-4abe-a9ed-2daa65e7138b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286882700" status: 202 len: 0 microversion: 2.1 time: 0.023115 Sep 09 21:32:57.028961 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 358/701] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 21:32:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286882700 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:33:00.139510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-edc9fb7d-8841-46cb-8067-1d9c13df981b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:00.140025 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-edc9fb7d-8841-46cb-8067-1d9c13df981b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:00.142558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:33:00.147845 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edc9fb7d-8841-46cb-8067-1d9c13df981b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:00.148334 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edc9fb7d-8841-46cb-8067-1d9c13df981b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:00.148777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edc9fb7d-8841-46cb-8067-1d9c13df981b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:00.149464 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edc9fb7d-8841-46cb-8067-1d9c13df981b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:00.149925 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edc9fb7d-8841-46cb-8067-1d9c13df981b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:00.150354 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-edc9fb7d-8841-46cb-8067-1d9c13df981b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:00.176781 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-edc9fb7d-8841-46cb-8067-1d9c13df981b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:33:00.251981 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-edc9fb7d-8841-46cb-8067-1d9c13df981b tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 204 len: 0 microversion: 2.1 time: 0.115948 Sep 09 21:33:00.252593 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 344/702] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:33:00 2022] DELETE /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:33:00.260907 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bcaa69c5-882e-48c4-9e6b-57033e69eb74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:00.261521 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bcaa69c5-882e-48c4-9e6b-57033e69eb74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:00.270031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bcaa69c5-882e-48c4-9e6b-57033e69eb74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:00.270524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bcaa69c5-882e-48c4-9e6b-57033e69eb74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:00.270962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bcaa69c5-882e-48c4-9e6b-57033e69eb74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:00.271686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bcaa69c5-882e-48c4-9e6b-57033e69eb74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:00.272148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bcaa69c5-882e-48c4-9e6b-57033e69eb74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:00.272577 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bcaa69c5-882e-48c4-9e6b-57033e69eb74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:00.403204 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bcaa69c5-882e-48c4-9e6b-57033e69eb74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:00.411633 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bcaa69c5-882e-48c4-9e6b-57033e69eb74 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1508 microversion: 2.1 time: 0.154862 Sep 09 21:33:00.412198 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 359/703] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:33:00 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:33:01.435994 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4e27f803-90d4-44f4-ba18-76e160d3ad96 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:01.436747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4e27f803-90d4-44f4-ba18-76e160d3ad96 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:01.443247 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e27f803-90d4-44f4-ba18-76e160d3ad96 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:01.443775 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e27f803-90d4-44f4-ba18-76e160d3ad96 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:01.444220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e27f803-90d4-44f4-ba18-76e160d3ad96 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:01.444920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e27f803-90d4-44f4-ba18-76e160d3ad96 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:01.445381 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e27f803-90d4-44f4-ba18-76e160d3ad96 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:01.445813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e27f803-90d4-44f4-ba18-76e160d3ad96 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:01.698872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4e27f803-90d4-44f4-ba18-76e160d3ad96 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:01.704557 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-bd7a0610-2b37-4974-80d8-5a6979c70afa req-4a7db448-16b6-4e83-a0c0-43f155544456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3828efac-904c-481a-95a5-a84a7b581b83", "name": "network-vif-deleted", "tag": "723c7e34-a091-4242-9709-6b7cea72ecf4"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:33:01.710106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4e27f803-90d4-44f4-ba18-76e160d3ad96 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 200 len: 1508 microversion: 2.1 time: 0.278115 Sep 09 21:33:01.710691 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 345/704] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:33:01 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:33:01.715637 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-bd7a0610-2b37-4974-80d8-5a6979c70afa req-4a7db448-16b6-4e83-a0c0-43f155544456 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:01.716323 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-bd7a0610-2b37-4974-80d8-5a6979c70afa req-4a7db448-16b6-4e83-a0c0-43f155544456 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:01.717019 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-bd7a0610-2b37-4974-80d8-5a6979c70afa req-4a7db448-16b6-4e83-a0c0-43f155544456 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:01.732451 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-bd7a0610-2b37-4974-80d8-5a6979c70afa req-4a7db448-16b6-4e83-a0c0-43f155544456 service nova] Creating event network-vif-deleted:723c7e34-a091-4242-9709-6b7cea72ecf4 for instance 3828efac-904c-481a-95a5-a84a7b581b83 on hv-cinder-85221 Sep 09 21:33:01.738118 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-bd7a0610-2b37-4974-80d8-5a6979c70afa req-4a7db448-16b6-4e83-a0c0-43f155544456 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046468 Sep 09 21:33:01.738715 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 360/705] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:33:02.736538 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:02.737148 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 3828efac-904c-481a-95a5-a84a7b581b83] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:02.743460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:02.743976 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:02.744410 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:02.745087 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:02.745539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:02.745965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:02.759375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] HTTP exception thrown: Instance 3828efac-904c-481a-95a5-a84a7b581b83 could not be found. Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Request method failure captured: Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 HTTP/1.1 Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG6-hYeoA0KilbcouWpERZ9YtQ82F_IJMypUZNsqF-LHQO0jXBghrw_akyfPTZ9RfD5QZsUC56WPkMWHPye2TMrxCBvzQNtqia3kTLk6srJ6joD45wfLdTCle-w3LQa2RNfPLhaz2Ly1gmO4Nr9NiDeNh0DEz2qj6shMAQnL2Zfug0yo Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 5472cdfe59524ac5b826fba54758c68f Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:33:02.761015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5472cdfe59524ac5b826fba54758c68f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5472cdfe59524ac5b826fba54758c68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5472cdfe59524ac5b826fba54758c68f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5472cdfe59524ac5b826fba54758c68f"}]}] Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 5472cdfe59524ac5b826fba54758c68f Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-ServerRescueNegativeTestJSON-1311387682-project Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 0d773c7f6aca4ea2ad2872f67e9116af Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311387682-project Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 3828efac-904c-481a-95a5-a84a7b581b83 could not be found. Sep 09 21:33:02.762605 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '3828efac-904c-481a-95a5-a84a7b581b83'} Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3828efac-904c-481a-95a5-a84a7b581b83 could not be found. Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:33:02.763558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3828efac-904c-481a-95a5-a84a7b581b83 could not be found. Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3828efac-904c-481a-95a5-a84a7b581b83 could not be found. Sep 09 21:33:02.765550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:02.766833 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Returning 404 to user: Instance 3828efac-904c-481a-95a5-a84a7b581b83 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:33:02.766833 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3eeef4a2-3401-4fe6-88a6-115a6fe5d6b2 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83" status: 404 len: 111 microversion: 2.1 time: 0.029732 Sep 09 21:33:02.766833 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 346/706] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:33:02 2022] GET /compute/v2.1/servers/3828efac-904c-481a-95a5-a84a7b581b83 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:33:02.772485 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-68b7966f-acd0-4031-88fa-4c634c66c9ff tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:02.773067 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-68b7966f-acd0-4031-88fa-4c634c66c9ff tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:02.774961 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:33:02.780701 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-68b7966f-acd0-4031-88fa-4c634c66c9ff tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:02.781444 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-68b7966f-acd0-4031-88fa-4c634c66c9ff tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:02.781882 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-68b7966f-acd0-4031-88fa-4c634c66c9ff tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:02.782568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-68b7966f-acd0-4031-88fa-4c634c66c9ff tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:02.783029 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-68b7966f-acd0-4031-88fa-4c634c66c9ff tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:02.783455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-68b7966f-acd0-4031-88fa-4c634c66c9ff tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:02.811226 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-68b7966f-acd0-4031-88fa-4c634c66c9ff tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:33:02.881848 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-68b7966f-acd0-4031-88fa-4c634c66c9ff tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 204 len: 0 microversion: 2.1 time: 0.113722 Sep 09 21:33:02.882439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 361/707] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:33:02 2022] DELETE /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:33:02.891380 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2c4e27fc-a62d-438e-94be-f2bd278b952a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:02.891958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2c4e27fc-a62d-438e-94be-f2bd278b952a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:02.897936 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2c4e27fc-a62d-438e-94be-f2bd278b952a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:02.898465 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2c4e27fc-a62d-438e-94be-f2bd278b952a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:02.898914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2c4e27fc-a62d-438e-94be-f2bd278b952a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:02.899640 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2c4e27fc-a62d-438e-94be-f2bd278b952a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:02.900105 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2c4e27fc-a62d-438e-94be-f2bd278b952a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:02.900540 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2c4e27fc-a62d-438e-94be-f2bd278b952a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:03.033568 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2c4e27fc-a62d-438e-94be-f2bd278b952a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:03.041123 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2c4e27fc-a62d-438e-94be-f2bd278b952a tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.154532 Sep 09 21:33:03.041680 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 347/708] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:33:02 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:33:04.064282 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f6eaee49-25ca-445f-b48d-a7ebbba831e7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:04.064979 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f6eaee49-25ca-445f-b48d-a7ebbba831e7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:04.071209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6eaee49-25ca-445f-b48d-a7ebbba831e7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:04.071719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6eaee49-25ca-445f-b48d-a7ebbba831e7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:04.072157 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6eaee49-25ca-445f-b48d-a7ebbba831e7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:04.072826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6eaee49-25ca-445f-b48d-a7ebbba831e7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:04.073278 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6eaee49-25ca-445f-b48d-a7ebbba831e7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:04.073698 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f6eaee49-25ca-445f-b48d-a7ebbba831e7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:04.209127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f6eaee49-25ca-445f-b48d-a7ebbba831e7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:04.216662 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f6eaee49-25ca-445f-b48d-a7ebbba831e7 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.156621 Sep 09 21:33:04.217314 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 362/709] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:33:04 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:33:05.239992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f2ba6c5f-d6da-466a-a449-0f8a5b6ece75 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:05.240609 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f2ba6c5f-d6da-466a-a449-0f8a5b6ece75 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:05.247047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2ba6c5f-d6da-466a-a449-0f8a5b6ece75 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:05.247549 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2ba6c5f-d6da-466a-a449-0f8a5b6ece75 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:05.247992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2ba6c5f-d6da-466a-a449-0f8a5b6ece75 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:05.248982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2ba6c5f-d6da-466a-a449-0f8a5b6ece75 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:05.249446 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2ba6c5f-d6da-466a-a449-0f8a5b6ece75 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:05.249874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f2ba6c5f-d6da-466a-a449-0f8a5b6ece75 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:05.377895 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f2ba6c5f-d6da-466a-a449-0f8a5b6ece75 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:05.385487 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f2ba6c5f-d6da-466a-a449-0f8a5b6ece75 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1522 microversion: 2.1 time: 0.149379 Sep 09 21:33:05.386039 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 348/710] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:33:05 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:33:06.318447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-48caac5b-9f80-4c08-ae03-d986382f9b5a req-7a7e9115-e252-4e44-8b32-f97a1448e474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eedc741-6d4f-4cbd-9a25-a712414a9bbe", "name": "network-vif-deleted", "tag": "5c478caa-364f-4a8c-86e9-be8edf26fbe4"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:33:06.330962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-48caac5b-9f80-4c08-ae03-d986382f9b5a req-7a7e9115-e252-4e44-8b32-f97a1448e474 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:06.331443 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-48caac5b-9f80-4c08-ae03-d986382f9b5a req-7a7e9115-e252-4e44-8b32-f97a1448e474 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:06.331908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-48caac5b-9f80-4c08-ae03-d986382f9b5a req-7a7e9115-e252-4e44-8b32-f97a1448e474 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:06.345977 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-48caac5b-9f80-4c08-ae03-d986382f9b5a req-7a7e9115-e252-4e44-8b32-f97a1448e474 service nova] Creating event network-vif-deleted:5c478caa-364f-4a8c-86e9-be8edf26fbe4 for instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe on hv-cinder-85221 Sep 09 21:33:06.351229 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-48caac5b-9f80-4c08-ae03-d986382f9b5a req-7a7e9115-e252-4e44-8b32-f97a1448e474 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036381 Sep 09 21:33:06.352545 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 363/711] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:33:06.410503 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-133b0775-026a-44df-bf79-dffada636802 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:06.411917 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-133b0775-026a-44df-bf79-dffada636802 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:06.418875 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-133b0775-026a-44df-bf79-dffada636802 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:06.419702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-133b0775-026a-44df-bf79-dffada636802 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:06.421302 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-133b0775-026a-44df-bf79-dffada636802 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:06.422114 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-133b0775-026a-44df-bf79-dffada636802 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:06.422740 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-133b0775-026a-44df-bf79-dffada636802 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:06.423382 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-133b0775-026a-44df-bf79-dffada636802 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:06.494684 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-133b0775-026a-44df-bf79-dffada636802 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d773c7f6aca4ea2ad2872f67e9116af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5472cdfe59524ac5b826fba54758c68f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:06.510912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-133b0775-026a-44df-bf79-dffada636802 tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 200 len: 1307 microversion: 2.1 time: 0.106279 Sep 09 21:33:06.511490 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 349/712] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:33:06 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:33:07.534585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:07.535280 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] [instance: 5eedc741-6d4f-4cbd-9a25-a712414a9bbe] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:07.541827 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:07.542310 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:07.542747 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:07.543430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:07.543916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:07.544345 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:07.557486 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] HTTP exception thrown: Instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe could not be found. Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Request method failure captured: Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe HTTP/1.1 Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG6-hYeoA0KilbcouWpERZ9YtQ82F_IJMypUZNsqF-LHQO0jXBghrw_akyfPTZ9RfD5QZsUC56WPkMWHPye2TMrxCBvzQNtqia3kTLk6srJ6joD45wfLdTCle-w3LQa2RNfPLhaz2Ly1gmO4Nr9NiDeNh0DEz2qj6shMAQnL2Zfug0yo Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 5472cdfe59524ac5b826fba54758c68f Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:33:07.559119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5472cdfe59524ac5b826fba54758c68f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5472cdfe59524ac5b826fba54758c68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5472cdfe59524ac5b826fba54758c68f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5472cdfe59524ac5b826fba54758c68f"}]}] Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 5472cdfe59524ac5b826fba54758c68f Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311387682 Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-ServerRescueNegativeTestJSON-1311387682-project Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 0d773c7f6aca4ea2ad2872f67e9116af Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311387682-project Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe could not be found. Sep 09 21:33:07.561220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '5eedc741-6d4f-4cbd-9a25-a712414a9bbe'} Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe could not be found. Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:33:07.562041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe could not be found. Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe could not be found. Sep 09 21:33:07.563481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:33:07.564772 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] Returning 404 to user: Instance 5eedc741-6d4f-4cbd-9a25-a712414a9bbe could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:33:07.564772 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c249b5bd-ccf7-4cbd-86a0-cb2100f3f88e tempest-ServerRescueNegativeTestJSON-1311387682 tempest-ServerRescueNegativeTestJSON-1311387682-project] 10.222.0.46 "GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe" status: 404 len: 111 microversion: 2.1 time: 0.030568 Sep 09 21:33:07.564772 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 364/713] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:33:07 2022] GET /compute/v2.1/servers/5eedc741-6d4f-4cbd-9a25-a712414a9bbe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:33:12.202607 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-51c4d3df-259b-4227-a521-5dc2e8d17422 tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] Action: 'create', calling method: .version_select at 0x7f0812e51d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-654488788", "metadata": {"Type": "work"}}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:33:12.497086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-51c4d3df-259b-4227-a521-5dc2e8d17422 tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.410679 Sep 09 21:33:12.508329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 350/714] 10.222.0.46 () {60 vars in 1156 bytes} [Fri Sep 9 21:33:12 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 423 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 21:33:12.511118 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-658c3faa-f3d9-4d8a-a1fc-102ebfe6a1c6 tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] Calling method '.version_select at 0x7f0816761430>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:12.563367 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-658c3faa-f3d9-4d8a-a1fc-102ebfe6a1c6 tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc" status: 200 len: 352 microversion: 2.1 time: 0.055839 Sep 09 21:33:12.563989 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 365/715] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:33:12 2022] GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:33:13.578621 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-79977b7c-c792-43df-a851-bb18ecb8ea67 tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] Calling method '.version_select at 0x7f0812de4430>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:13.627578 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-79977b7c-c792-43df-a851-bb18ecb8ea67 tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc" status: 200 len: 353 microversion: 2.1 time: 0.053756 Sep 09 21:33:13.628147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 351/716] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:33:13 2022] GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:33:13.642389 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b8fc97d9-8d96-4e00-8ac1-3d0f9b6e309f tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] Calling method '.version_select at 0x7f08167465e0>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:13.688100 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b8fc97d9-8d96-4e00-8ac1-3d0f9b6e309f tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc" status: 200 len: 353 microversion: 2.1 time: 0.051094 Sep 09 21:33:13.688648 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 366/717] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:33:13 2022] GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:33:13.706591 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-80933e26-3506-4853-9f17-16d60798c097 tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] Calling method '.version_select at 0x7f081301d4c0>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:13.767557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-80933e26-3506-4853-9f17-16d60798c097 tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc" status: 202 len: 0 microversion: 2.1 time: 0.064654 Sep 09 21:33:13.768174 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 352/718] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:33:13 2022] DELETE /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 21:33:13.775967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-79ce3af9-f552-4874-956a-d4afd5ad000f tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] Calling method '.version_select at 0x7f0812f43f70>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:13.827565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-79ce3af9-f552-4874-956a-d4afd5ad000f tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc" status: 200 len: 352 microversion: 2.1 time: 0.055273 Sep 09 21:33:13.828131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 367/719] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:33:13 2022] GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:33:14.843620 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-575572dc-4f5b-4aff-9275-1e118cc8697c tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] Calling method '.version_select at 0x7f0812e51dc0>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:14.873021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-575572dc-4f5b-4aff-9275-1e118cc8697c tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] HTTP exception thrown: Volume 27584d34-123f-426f-8472-f28764606fcc could not be found. Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-575572dc-4f5b-4aff-9275-1e118cc8697c tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] Request method failure captured: Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc HTTP/1.1 Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7EY_z7HZdX6hAmHuXEaT848DnYoVjmQveJb_q7RUAv-k8Tw3PDmd8Zhh3pFlOvq0IkMcMTDZZiRvYfYdX8eY8VfBF7V4YCt6by1tPktwRvsLSWU1uSNDHLWmmjt710mbQ-_PjqN69Jxf_etlpsext85mSsOL8q7Q3zyxCx2FFIWfOI Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 11ee81c6183143f1ac150a1c6329d135 Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesGetTestJSON-688086697 Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:33:14.874937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_11ee81c6183143f1ac150a1c6329d135", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/11ee81c6183143f1ac150a1c6329d135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/11ee81c6183143f1ac150a1c6329d135"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/11ee81c6183143f1ac150a1c6329d135"}]}] Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesGetTestJSON-688086697 Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 11ee81c6183143f1ac150a1c6329d135 Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesGetTestJSON-688086697 Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesGetTestJSON-688086697-project Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 0e1d48d19259466392fc530617eb11bf Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesGetTestJSON-688086697-project Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Volume 27584d34-123f-426f-8472-f28764606fcc could not be found. Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '27584d34-123f-426f-8472-f28764606fcc'} Sep 09 21:33:14.876560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27584d34-123f-426f-8472-f28764606fcc could not be found. (HTTP 404) (Request-ID: req-457c109a-5245-49a7-a116-527594fa716c) Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:33:14.877559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:33:14.878958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27584d34-123f-426f-8472-f28764606fcc could not be found. Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 21:33:14.880374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27584d34-123f-426f-8472-f28764606fcc could not be found. Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27584d34-123f-426f-8472-f28764606fcc could not be found. Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-575572dc-4f5b-4aff-9275-1e118cc8697c tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] Returning 404 to user: Volume 27584d34-123f-426f-8472-f28764606fcc could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-575572dc-4f5b-4aff-9275-1e118cc8697c tempest-VolumesGetTestJSON-688086697 tempest-VolumesGetTestJSON-688086697-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc" status: 404 len: 109 microversion: 2.1 time: 0.038393 Sep 09 21:33:14.881722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 353/720] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:33:14 2022] GET /compute/v2.1/os-volumes/27584d34-123f-426f-8472-f28764606fcc => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:33:18.958845 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:33:18.959619 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:33:18.964353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6d75d856-91cc-47f0-acb9-db1a9117c095 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:18.964871 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6d75d856-91cc-47f0-acb9-db1a9117c095 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:18.973499 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d75d856-91cc-47f0-acb9-db1a9117c095 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:18.973982 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d75d856-91cc-47f0-acb9-db1a9117c095 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:18.974415 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d75d856-91cc-47f0-acb9-db1a9117c095 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:18.975096 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d75d856-91cc-47f0-acb9-db1a9117c095 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:18.975565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d75d856-91cc-47f0-acb9-db1a9117c095 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:18.975992 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d75d856-91cc-47f0-acb9-db1a9117c095 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:19.000678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6d75d856-91cc-47f0-acb9-db1a9117c095 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/ips" status: 200 len: 152 microversion: 2.20 time: 0.043064 Sep 09 21:33:19.001241 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 368/721] 10.222.0.46 () {60 vars in 1289 bytes} [Fri Sep 9 21:33:18 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 21:33:21.009818 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:33:21.012171 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=56,nova_cell1:UPDATE=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:33:21.017065 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f8b7bf92-df52-49a4-8968-9b80f0144042 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:33:21.017600 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f8b7bf92-df52-49a4-8968-9b80f0144042 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:21.025354 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f8b7bf92-df52-49a4-8968-9b80f0144042 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:21.025761 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f8b7bf92-df52-49a4-8968-9b80f0144042 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:21.026201 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f8b7bf92-df52-49a4-8968-9b80f0144042 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:21.026892 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f8b7bf92-df52-49a4-8968-9b80f0144042 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:21.027352 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f8b7bf92-df52-49a4-8968-9b80f0144042 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:21.027805 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f8b7bf92-df52-49a4-8968-9b80f0144042 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:21.051322 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-f8b7bf92-df52-49a4-8968-9b80f0144042 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lazy-loading 'flavor' on Instance uuid 4346b807-8641-4458-98d2-c1072c799994 {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:33:21.254535 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f8b7bf92-df52-49a4-8968-9b80f0144042 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "POST /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/action" status: 202 len: 0 microversion: 2.20 time: 0.245765 Sep 09 21:33:21.255422 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 354/722] 10.222.0.46 () {62 vars in 1319 bytes} [Fri Sep 9 21:33:21 2022] POST /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:33:21.264112 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:21.264819 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:21.271423 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:21.271961 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:21.272401 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:21.273100 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:21.273735 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:21.274331 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:21.441841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:21.450398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:21.452763 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:21.454210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f3b60fee-1bd5-4da8-b6b1-311fe51ab5da tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.194614 Sep 09 21:33:21.454847 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 369/723] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:21 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:22.480531 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:22.481236 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:22.488439 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:22.488932 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:22.489376 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:22.490071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:22.490534 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:22.490967 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:22.626660 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:22.635924 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:22.638948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:22.640169 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a9d955f6-fa64-4a96-9524-e9a62125f82c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.164416 Sep 09 21:33:22.640776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 355/724] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:22 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:23.665791 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:23.666476 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:23.674038 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:23.674540 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:23.674976 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:23.675745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:23.676212 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:23.676639 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:23.813177 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:23.821194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:23.822616 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:23.823830 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7ecfdc11-d8c6-4e93-abb3-863950112179 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.161841 Sep 09 21:33:23.824368 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 370/725] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:23 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:24.850379 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:24.850918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:24.857899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:24.858393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:24.858836 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:24.859775 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:24.860245 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:24.860678 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:25.064312 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:25.072351 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:25.073856 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:25.075019 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f77735cd-f56d-43bb-9628-ceffa17c8139 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.228723 Sep 09 21:33:25.076240 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 356/726] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:24 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:26.102971 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:26.103624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:26.110515 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:26.110992 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:26.111423 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:26.112126 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:26.112575 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:26.112993 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:26.240644 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:26.248962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:26.250386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:26.251552 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-faf38483-08ed-4373-a16c-1a6b8c9d904f tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.154105 Sep 09 21:33:26.252111 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 371/727] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:26 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:27.276194 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:27.276826 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:27.283734 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:27.284221 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:27.284670 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:27.285356 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:27.285814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:27.286242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:27.427215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:27.436445 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:27.437887 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:27.439048 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-03f7ea1e-4c2f-4b4c-9163-81b625fac26d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.166646 Sep 09 21:33:27.439827 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 357/728] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:27 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:28.464750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:28.465353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:28.475889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:28.477088 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:28.477527 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:28.478221 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:28.478677 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:28.481212 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:28.616636 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:28.624663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:28.626092 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:28.627264 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d75ba025-6897-4177-9b6e-4cba225eca07 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.166382 Sep 09 21:33:28.627822 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 372/729] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:28 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:29.654235 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:29.654847 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:29.661406 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:29.661889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:29.662326 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:29.663008 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:29.663459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:29.663907 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:29.800384 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:29.809018 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:29.811173 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:29.812455 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e98cc5ba-aab3-4e4c-afad-18ee4e45cbce tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.163546 Sep 09 21:33:29.813006 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 358/730] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:29 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:30.838495 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:30.839232 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:30.845669 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:30.846156 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:30.846592 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:30.847273 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:30.847754 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:30.848176 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:30.981209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:30.989801 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:30.991235 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:30.992428 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-678b0bd4-5b1d-49a9-a38a-19f29a9429af tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.158102 Sep 09 21:33:30.992975 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 373/731] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:30 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:32.018949 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:32.019573 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:32.025957 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:32.026442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:32.026880 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:32.027585 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:32.028047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:32.028480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:32.163890 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:32.172475 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:32.173904 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:32.175060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-060e1323-d72e-43be-bc83-e3b19bbe5c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.160063 Sep 09 21:33:32.175630 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 359/732] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:32 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:33.200612 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:33.201297 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:33.208219 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:33.208712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:33.209154 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:33.209861 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:33.210324 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:33.210752 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:33.347615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:33.355666 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:33.358006 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:33.359197 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c8bb3d8a-21ca-417b-9362-512a6cc78d86 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.163051 Sep 09 21:33:33.359782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 374/733] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:33 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:34.386237 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:34.386801 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:34.393728 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:34.394222 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:34.394655 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:34.395343 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:34.395827 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:34.396252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:34.538866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:34.548071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:34.549492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:34.550648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c48f0666-4dfa-4925-aee8-5e251eb51803 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.168592 Sep 09 21:33:34.551197 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 360/734] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:34 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:35.576399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:35.577015 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:35.583621 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:35.584115 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:35.584558 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:35.585248 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:35.585711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:35.586141 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:35.719656 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:35.727727 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:35.729103 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:35.730256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-44007061-0d1d-4a7e-abd1-08fe516eeab7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.158005 Sep 09 21:33:35.730843 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 375/735] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:35 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:36.757095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:36.759087 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:36.766137 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:36.766636 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:36.767080 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:36.767806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:36.768263 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:36.768689 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:36.902232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:36.912549 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:36.914019 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:36.915185 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1fa894b4-7a67-45de-96a8-502bad33cd73 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.162107 Sep 09 21:33:36.915767 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 361/736] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:36 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:37.940656 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:37.941255 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:37.949569 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:37.950060 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:37.950496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:37.951191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:37.951686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:37.952110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:38.090504 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:38.099210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:38.100688 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:38.101927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8acf96b5-b5c8-49ad-b45a-1208d549e916 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.165366 Sep 09 21:33:38.102630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 376/737] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:37 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:39.128758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:39.129434 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:39.135465 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:39.135980 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:39.136424 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:39.137120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:39.137677 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:39.138107 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:39.277755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:39.287560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:39.289062 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:39.290368 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2baa51ed-52c7-4112-8324-605fce06bc48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1744 microversion: 2.20 time: 0.166517 Sep 09 21:33:39.290927 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 362/738] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:39 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:40.316314 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:40.316926 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:40.323254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:40.323777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:40.324217 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:40.324907 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:40.325365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:40.325790 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:40.463807 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:40.471785 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:40.473217 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:40.474363 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a411315e-c2dd-4ad9-aaff-8e6fb167cc03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1744 microversion: 2.20 time: 0.163013 Sep 09 21:33:40.474919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 377/739] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:40 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:41.499611 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:41.502982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:41.509547 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:41.510044 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:41.510486 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:41.511187 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:41.511673 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:41.512102 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:41.641847 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:41.649857 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:41.651276 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:41.652438 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-295c39aa-aeb8-47a4-b391-e420c812c877 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1744 microversion: 2.20 time: 0.156712 Sep 09 21:33:41.652987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 363/740] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:41 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:42.678434 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:42.679046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:42.685080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:42.685569 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:42.686009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:42.686707 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:42.687167 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:42.688157 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:42.818507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:42.826547 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:42.828060 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:42.829248 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b9a46eba-58cd-4adb-a213-dd59f2fef069 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1744 microversion: 2.20 time: 0.154954 Sep 09 21:33:42.829811 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 378/741] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:42 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:43.854707 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:43.855328 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:43.862976 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:43.863476 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:43.863943 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:43.864678 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:43.865137 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:43.865565 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:43.956609 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-9c00a6f5-02c4-4e62-9987-121ac4cdef69 req-592a76a8-7d84-4e73-a2ec-bd5d8454b041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4346b807-8641-4458-98d2-c1072c799994", "name": "network-vif-plugged", "status": "completed", "tag": "d23cedea-0322-45bd-8b29-1ff96462c426"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:33:43.993695 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-9c00a6f5-02c4-4e62-9987-121ac4cdef69 req-592a76a8-7d84-4e73-a2ec-bd5d8454b041 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:43.994188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-9c00a6f5-02c4-4e62-9987-121ac4cdef69 req-592a76a8-7d84-4e73-a2ec-bd5d8454b041 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:43.994624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-9c00a6f5-02c4-4e62-9987-121ac4cdef69 req-592a76a8-7d84-4e73-a2ec-bd5d8454b041 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:44.006257 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-9c00a6f5-02c4-4e62-9987-121ac4cdef69 req-592a76a8-7d84-4e73-a2ec-bd5d8454b041 service nova] Creating event network-vif-plugged:d23cedea-0322-45bd-8b29-1ff96462c426 for instance 4346b807-8641-4458-98d2-c1072c799994 on hv-cinder-85221 Sep 09 21:33:44.011311 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-9c00a6f5-02c4-4e62-9987-121ac4cdef69 req-592a76a8-7d84-4e73-a2ec-bd5d8454b041 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058439 Sep 09 21:33:44.012317 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 379/742] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:33:44.024772 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:44.033997 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:44.037274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:44.038947 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e27396de-e342-4f40-a210-993153a33af9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.188485 Sep 09 21:33:44.043569 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 364/743] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:43 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:45.067358 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:45.068867 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:45.076104 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:45.076976 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:45.077484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:45.078311 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:45.078774 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:45.079205 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:45.263092 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:45.272737 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:45.275445 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:45.277228 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1d4defc1-9c97-43be-9837-e3258ac252ec tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.215510 Sep 09 21:33:45.278441 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 380/744] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:45 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:46.313472 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:46.315199 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:46.328760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:46.329213 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:46.329861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:46.330582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:46.331019 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:46.331442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:46.471431 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:46.479598 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:46.481691 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:46.482913 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c759677a-5698-480d-adde-53e23f6e0b03 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.174189 Sep 09 21:33:46.483559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 365/745] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:46 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:33:47.511888 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:47.512472 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:47.519650 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:47.520131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:47.520565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:47.521246 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:47.521701 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:47.522119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:47.666111 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:47.675688 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:47.677128 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:47.678842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7c3391cd-27ae-48ff-8868-18ff8c17efeb tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.170768 Sep 09 21:33:47.680408 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 381/746] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:47 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:48.705774 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:48.706418 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:48.713878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:48.714372 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:48.714818 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:48.715510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:48.716016 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:48.716445 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:48.857384 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:48.865798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:48.867225 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:48.868419 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ebc3c3c7-fc2b-4868-aec1-90a97af63adf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.166853 Sep 09 21:33:48.868972 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 366/747] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:48 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:49.900273 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:49.900897 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:49.904400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=29 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:33:49.910212 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:49.910853 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:49.911409 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:49.912353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:49.912941 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:49.913450 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:49.917692 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=79 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:33:50.062353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:50.071369 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:50.072839 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:50.073997 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-cf234342-53ca-4165-b23d-0f336bb2b6b9 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.181181 Sep 09 21:33:50.074617 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 382/748] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:49 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:51.100268 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:51.100894 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:51.104792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=27 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:33:51.109011 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:51.110004 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:51.110444 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:51.111142 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:51.111626 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:51.112109 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:51.114979 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:33:51.258916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:51.267773 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:51.269233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:51.270445 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-146f3675-0787-4b80-aa07-320fb7959cdf tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.174295 Sep 09 21:33:51.277435 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 367/749] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:51 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:52.299826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:52.300470 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:52.307111 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:52.307685 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:52.308259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:52.309111 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:52.309531 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:52.309957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:52.466970 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:52.476288 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:52.477731 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:52.479045 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-26a4aebc-3fdc-4298-b772-743566723144 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.185001 Sep 09 21:33:52.494913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 383/750] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:52 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:53.506639 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:53.507385 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:53.513967 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:53.514497 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:53.514970 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:53.516305 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:53.516794 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:53.517252 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:53.681797 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:53.699519 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:53.701451 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:53.702973 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2d353d28-548a-407d-9bff-2e317d65f2a5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.200422 Sep 09 21:33:53.703397 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 368/751] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:53 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:54.735061 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:54.736388 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:54.743449 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:54.744055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:54.744559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:54.745319 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:54.745838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:54.746324 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:54.901541 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:54.913056 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:54.914488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:54.915686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-288edc6b-320e-403b-abfa-3293a0a680f7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.185176 Sep 09 21:33:54.916247 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 384/752] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:54 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:55.944348 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:55.945722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:55.952529 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:55.953221 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:55.953686 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:55.954912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:55.955372 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:55.955838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:56.114794 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:56.127015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:56.128558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:56.129767 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-dddad8da-641a-41aa-9362-b010f43b6e59 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.189419 Sep 09 21:33:56.130987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 369/753] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:55 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:57.157508 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:57.158205 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:57.165694 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:57.166301 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:57.166810 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:57.167705 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:57.175064 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:57.175662 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:57.325534 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:57.333725 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:57.335163 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:57.336356 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8f15e8f3-e6af-4128-b4e9-f39f095f5857 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.183711 Sep 09 21:33:57.336905 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 385/754] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:57 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:58.362610 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:58.363225 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:58.369693 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:58.370182 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:58.370620 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:58.371302 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:58.371785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:58.372215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:58.499050 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:58.507093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:58.508578 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:58.509780 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5a6cf976-2095-4249-a3d1-3c8bbae7b83a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1739 microversion: 2.20 time: 0.151656 Sep 09 21:33:58.510360 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 370/755] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:58 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:33:59.535765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:33:59.536306 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:33:59.542629 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:59.543112 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:59.543576 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:59.544256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:33:59.544711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:33:59.545140 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:33:59.682340 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:59.690904 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:59.692378 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:33:59.693537 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e34abad6-5c4c-4f0e-bc9b-c9ae2603c2be tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1721 microversion: 2.20 time: 0.161923 Sep 09 21:33:59.694080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 386/756] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:33:59 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:00.718206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:00.718819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:00.725655 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:00.726145 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:00.726581 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:00.727268 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:00.727765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:00.728194 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:00.855034 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:00.863665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:00.865095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:00.866235 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-54889a98-c03c-494c-9538-cfc0f37bf850 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1721 microversion: 2.20 time: 0.151935 Sep 09 21:34:00.866781 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 371/757] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:00 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:01.893030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:01.893599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:01.899974 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:01.900462 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:01.900899 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:01.901608 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:01.902064 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:01.902489 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:02.031218 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:02.039716 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:02.041149 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:02.042313 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-96bce227-2947-41a9-97a5-392a790fd432 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1721 microversion: 2.20 time: 0.154233 Sep 09 21:34:02.043055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 387/758] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:01 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:03.067760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:03.068383 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:03.074681 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:03.075169 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:03.075645 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:03.076327 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:03.076786 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:03.077211 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:03.210220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:03.218179 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:03.219983 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:03.221168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-84c9a326-3cca-4b2c-a768-244d7fe2cb48 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1664 microversion: 2.20 time: 0.158143 Sep 09 21:34:03.221728 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 372/759] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:03 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:03.246172 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-08ebeb58-880e-4272-9def-ab7b225f106d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea1609c6-3f2a-434d-8426-c81db1b65550"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:03.248498 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-08ebeb58-880e-4272-9def-ab7b225f106d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:03.255504 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-08ebeb58-880e-4272-9def-ab7b225f106d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:03.256015 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-08ebeb58-880e-4272-9def-ab7b225f106d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:03.256444 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-08ebeb58-880e-4272-9def-ab7b225f106d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:03.257125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-08ebeb58-880e-4272-9def-ab7b225f106d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:03.257574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-08ebeb58-880e-4272-9def-ab7b225f106d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:03.257995 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-08ebeb58-880e-4272-9def-ab7b225f106d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:03.519425 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-08ebeb58-880e-4272-9def-ab7b225f106d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "POST /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.277117 Sep 09 21:34:03.520277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 388/760] 10.222.0.46 () {62 vars in 1364 bytes} [Fri Sep 9 21:34:03 2022] POST /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/os-volume_attachments => generated 188 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:34:03.643642 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-73ca4509-800f-46b9-8ae8-cbd2f386a5c7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:03.644128 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-73ca4509-800f-46b9-8ae8-cbd2f386a5c7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:03.650757 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-73ca4509-800f-46b9-8ae8-cbd2f386a5c7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:03.651397 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-73ca4509-800f-46b9-8ae8-cbd2f386a5c7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:03.652203 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-73ca4509-800f-46b9-8ae8-cbd2f386a5c7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:03.653410 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-73ca4509-800f-46b9-8ae8-cbd2f386a5c7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:03.653874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-73ca4509-800f-46b9-8ae8-cbd2f386a5c7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:03.654302 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-73ca4509-800f-46b9-8ae8-cbd2f386a5c7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:03.901760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-73ca4509-800f-46b9-8ae8-cbd2f386a5c7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/os-volume_attachments/ea1609c6-3f2a-434d-8426-c81db1b65550" status: 202 len: 0 microversion: 2.20 time: 0.262031 Sep 09 21:34:03.902358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 373/761] 10.222.0.46 () {60 vars in 1457 bytes} [Fri Sep 9 21:34:03 2022] DELETE /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/os-volume_attachments/ea1609c6-3f2a-434d-8426-c81db1b65550 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:34:03.966839 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1e6bce36-413a-4313-b665-7223ec063dda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:03.967422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1e6bce36-413a-4313-b665-7223ec063dda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:03.973640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e6bce36-413a-4313-b665-7223ec063dda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:03.974265 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e6bce36-413a-4313-b665-7223ec063dda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:03.974842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e6bce36-413a-4313-b665-7223ec063dda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:03.975557 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e6bce36-413a-4313-b665-7223ec063dda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:03.976018 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e6bce36-413a-4313-b665-7223ec063dda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:03.976445 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1e6bce36-413a-4313-b665-7223ec063dda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:04.006561 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1e6bce36-413a-4313-b665-7223ec063dda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120465) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 21:34:04.065357 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-74430ccd-1bc5-4c4a-8362-adf9573054a8 req-f7efb778-2102-461b-af71-5d8abd968550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4346b807-8641-4458-98d2-c1072c799994", "name": "network-vif-unplugged", "status": "completed", "tag": "d23cedea-0322-45bd-8b29-1ff96462c426"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:04.077283 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1e6bce36-413a-4313-b665-7223ec063dda tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "POST /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/action" status: 202 len: 0 microversion: 2.20 time: 0.113821 Sep 09 21:34:04.078504 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 389/762] 10.222.0.46 () {62 vars in 1319 bytes} [Fri Sep 9 21:34:03 2022] POST /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:34:04.084658 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-74430ccd-1bc5-4c4a-8362-adf9573054a8 req-f7efb778-2102-461b-af71-5d8abd968550 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:04.085742 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-74430ccd-1bc5-4c4a-8362-adf9573054a8 req-f7efb778-2102-461b-af71-5d8abd968550 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:04.086345 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-74430ccd-1bc5-4c4a-8362-adf9573054a8 req-f7efb778-2102-461b-af71-5d8abd968550 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:04.087317 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:04.088066 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:04.096736 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:04.097352 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:04.098014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:04.098882 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:04.099009 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.compute.server_external_events [req-74430ccd-1bc5-4c4a-8362-adf9573054a8 req-f7efb778-2102-461b-af71-5d8abd968550 service nova] Unable to find a host for instance 4346b807-8641-4458-98d2-c1072c799994. Dropping event network-vif-unplugged {{(pid=120466) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 21:34:04.099331 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:04.099967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:04.100124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-74430ccd-1bc5-4c4a-8362-adf9573054a8 req-f7efb778-2102-461b-af71-5d8abd968550 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040819 Sep 09 21:34:04.101126 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 374/763] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 21:34:04.244584 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:04.255201 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:04.256742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:04.258050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-54eb6197-9e8e-4221-98fe-e363763a0a65 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1672 microversion: 2.20 time: 0.174812 Sep 09 21:34:04.258637 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 390/764] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:04 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:05.284351 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:05.284954 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:05.291325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:05.291843 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:05.292286 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:05.292968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:05.293419 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:05.294020 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:05.424869 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:05.432776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:05.434205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:05.435360 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-7e8f75da-389e-4237-b48c-737721dd67ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.155744 Sep 09 21:34:05.435960 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 375/765] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:05 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:06.461195 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:06.461962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:06.477649 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:06.478739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:06.480225 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:06.481358 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:06.482056 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:06.483516 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:06.840160 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:06.848915 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:06.850340 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:06.851478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3639f75c-f152-4048-be86-2a209c1a7108 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.394215 Sep 09 21:34:06.852054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 391/766] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:06 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:07.877522 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:07.878127 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:07.885484 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:07.886220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:07.886851 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:07.887638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:07.888047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:07.888474 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:08.029202 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:08.038558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:08.040059 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:08.041245 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-57848a01-eac0-4f47-a542-e92131aa93ea tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.167672 Sep 09 21:34:08.041803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 376/767] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:07 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:09.068608 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:09.069265 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:09.076866 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:09.077456 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:09.077973 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:09.079325 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:09.079852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:09.080557 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:09.222241 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:09.231160 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:09.232537 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:09.233686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7bdebfe6-d63c-4caf-82ef-e24b67b560d5 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.169059 Sep 09 21:34:09.234216 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 392/768] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:09 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:34:10.260503 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:10.261194 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:10.267951 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:10.268441 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:10.268933 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:10.269575 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:10.270037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:10.270467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:10.413120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:10.421640 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:10.423428 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:10.424834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8173c892-9d2a-4f60-9337-8afeba2eef4e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.168345 Sep 09 21:34:10.425398 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 377/769] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:10 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:11.013048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a39d17e8-19b4-4268-925f-e05b30f5aa96 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:11.013605 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a39d17e8-19b4-4268-925f-e05b30f5aa96 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:11.020268 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a39d17e8-19b4-4268-925f-e05b30f5aa96 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:11.020741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a39d17e8-19b4-4268-925f-e05b30f5aa96 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:11.021173 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a39d17e8-19b4-4268-925f-e05b30f5aa96 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:11.021855 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a39d17e8-19b4-4268-925f-e05b30f5aa96 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:11.022310 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a39d17e8-19b4-4268-925f-e05b30f5aa96 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:11.022736 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a39d17e8-19b4-4268-925f-e05b30f5aa96 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:11.051908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a39d17e8-19b4-4268-925f-e05b30f5aa96 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/ips" status: 200 len: 147 microversion: 2.1 time: 0.042616 Sep 09 21:34:11.052461 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 393/770] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:34:11 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:34:11.452261 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:11.452866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:11.459978 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:11.460458 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:11.460918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:11.461931 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:11.462533 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:11.462968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:11.596020 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:11.603925 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:11.605371 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:11.606505 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-29414bc5-73ce-482a-ab8f-ba3cee6f017b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.158117 Sep 09 21:34:11.607052 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 378/771] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:11 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:12.632427 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:12.633031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:12.639069 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:12.639574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:12.640012 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:12.640687 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:12.641141 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:12.641560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:12.782195 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:12.790209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:12.791630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:12.792773 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-092ce3a6-2302-4057-ad94-3ed94875e072 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.164365 Sep 09 21:34:12.793307 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 394/772] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:12 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:13.492043 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-757d43a3-fdc7-4a2f-9ea3-25b6180c0a94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76b6dcf7-50eb-4d36-9753-444f1bc0a769"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:13.494320 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-757d43a3-fdc7-4a2f-9ea3-25b6180c0a94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:13.500692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-757d43a3-fdc7-4a2f-9ea3-25b6180c0a94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:13.501174 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-757d43a3-fdc7-4a2f-9ea3-25b6180c0a94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:13.501609 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-757d43a3-fdc7-4a2f-9ea3-25b6180c0a94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:13.502344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-757d43a3-fdc7-4a2f-9ea3-25b6180c0a94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:13.502953 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-757d43a3-fdc7-4a2f-9ea3-25b6180c0a94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:13.503373 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-757d43a3-fdc7-4a2f-9ea3-25b6180c0a94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:13.821366 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:13.822090 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:13.830615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:13.831480 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:13.832194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:13.833271 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:13.833739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:13.834182 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:13.859646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:13.990074 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:13.999893 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:14.001321 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:14.002557 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d00871b7-c908-436f-b336-19fec9368752 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.186750 Sep 09 21:34:14.003091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 395/773] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:13 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:15.029417 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:15.030449 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:15.037925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:15.038585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:15.039129 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:15.039980 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:15.040548 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:15.041085 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:15.192892 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:15.203271 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:15.204732 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:15.206600 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3fe3c062-f2a9-453b-9aa2-5ccf11b1e193 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.181429 Sep 09 21:34:15.207338 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 396/774] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:15 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:34:16.233837 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:16.234517 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:16.241050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:16.241607 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:16.242048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:16.242807 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:16.243275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:16.243779 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:16.401481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:16.410525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:16.411993 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:16.413156 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-687451f1-2c4e-4c37-8f8b-3f8f25f7ddb2 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.183361 Sep 09 21:34:16.413699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 397/775] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:16 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:34:17.438726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:17.440122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:17.447026 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:17.447573 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:17.448020 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:17.448727 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:17.449201 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:17.449627 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:17.680282 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:17.688283 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:17.690388 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:17.691644 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4d628509-18dc-4227-8211-48c9f2bd17e1 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.256926 Sep 09 21:34:17.692153 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 398/776] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:17 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:34:18.717741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:18.718426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:18.725815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:18.726560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:18.727003 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:18.727728 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:18.728186 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:18.728615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:18.900560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:18.910392 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:18.912225 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:18.913434 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e4ee89bf-eb6f-47db-95e5-e5e62fb0010d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.199625 Sep 09 21:34:18.914161 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 399/777] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:18 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:34:19.941760 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:19.942400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:19.945083 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:19.951941 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:19.952699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:19.953146 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:19.953860 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:19.954347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:19.954781 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:20.095018 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:20.108224 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:20.109813 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:20.111289 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-188d692e-7ee0-45c0-9840-52d20f14ec28 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.173925 Sep 09 21:34:20.111883 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 400/778] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:19 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:34:21.137576 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:21.138159 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:21.157317 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:21.157960 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:21.161123 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:21.163676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:21.164955 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:21.172284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:21.352670 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:21.361282 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:21.362969 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:21.364255 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-39246228-89b1-4dc6-b108-880af3dd019e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.230746 Sep 09 21:34:21.364800 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 401/779] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:21 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:34:21.577074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:21.715456 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-757d43a3-fdc7-4a2f-9ea3-25b6180c0a94 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.228411 Sep 09 21:34:21.716329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 379/780] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:34:13 2022] POST /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments => generated 194 bytes in 8231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:22.393160 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:22.394428 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:22.402203 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:22.402931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:22.403611 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:22.404474 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:22.405468 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:22.406120 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:22.635429 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:22.647512 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:22.649279 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:22.650962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d129ae50-25b7-47ea-8032-f8e81a42b15c tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.264694 Sep 09 21:34:22.652060 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 402/781] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:22 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:23.680388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:23.683275 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:23.690976 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=25 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:23.693350 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:23.694213 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:23.695093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:23.696497 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:23.697162 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:23.697784 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:23.878165 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:23.886674 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:23.888515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:23.889916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-278eb194-0b84-466d-94cf-eceb7dca1e3b tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.216526 Sep 09 21:34:23.890991 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 380/782] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:23 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:24.916748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:24.917352 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:24.925138 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:24.926045 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:24.926837 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:24.928134 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:24.928993 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:24.929912 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:25.116061 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:25.128726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:25.130466 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:25.131984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-30a00d80-6ae3-4b46-9f2a-6d306c72472a tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.219006 Sep 09 21:34:25.132792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 403/783] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:24 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:34:26.161301 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:26.161909 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:26.170989 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:26.171898 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:26.176552 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:26.177778 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:26.178609 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:26.201698 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:26.288661 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-1bfee2ff-f3c5-4ac6-acef-486ab460d00f req-9055c0cb-3984-4a74-ab9f-0669305a3b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4346b807-8641-4458-98d2-c1072c799994", "name": "network-vif-plugged", "status": "completed", "tag": "d23cedea-0322-45bd-8b29-1ff96462c426"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:26.308681 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-1bfee2ff-f3c5-4ac6-acef-486ab460d00f req-9055c0cb-3984-4a74-ab9f-0669305a3b62 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:26.309513 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-1bfee2ff-f3c5-4ac6-acef-486ab460d00f req-9055c0cb-3984-4a74-ab9f-0669305a3b62 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:26.309829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-1bfee2ff-f3c5-4ac6-acef-486ab460d00f req-9055c0cb-3984-4a74-ab9f-0669305a3b62 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:26.334468 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-1bfee2ff-f3c5-4ac6-acef-486ab460d00f req-9055c0cb-3984-4a74-ab9f-0669305a3b62 service nova] Creating event network-vif-plugged:d23cedea-0322-45bd-8b29-1ff96462c426 for instance 4346b807-8641-4458-98d2-c1072c799994 on hv-cinder-85221 Sep 09 21:34:26.339757 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-1bfee2ff-f3c5-4ac6-acef-486ab460d00f req-9055c0cb-3984-4a74-ab9f-0669305a3b62 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054654 Sep 09 21:34:26.340613 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 404/784] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:34:27.016524 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:27.025138 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:27.026600 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:27.027922 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-bd112760-8594-415d-825f-203a34bca493 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.870702 Sep 09 21:34:27.028793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 381/785] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:26 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:28.058637 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:28.059484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:28.070072 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:28.070916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:28.071623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:28.072557 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:28.073215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:28.073872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:28.397798 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:28.411808 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:28.416032 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:28.420411 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-53223349-f561-455c-87a7-35434e2676ab tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.367702 Sep 09 21:34:28.443708 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 405/786] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:28 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:29.449257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:29.449931 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:29.460414 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:29.461270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:29.462433 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:29.463667 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:29.464510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:29.465198 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:29.851680 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:29.868468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:29.871782 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:29.876216 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-716766a6-f40c-4af4-864b-6692fa854205 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1730 microversion: 2.20 time: 0.429955 Sep 09 21:34:29.877594 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 382/787] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:29 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1730 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:30.583391 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f56b0093-149f-4036-92ec-d363babbdc38 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:30.585882 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f56b0093-149f-4036-92ec-d363babbdc38 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:30.601297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f56b0093-149f-4036-92ec-d363babbdc38 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.601794 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f56b0093-149f-4036-92ec-d363babbdc38 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.602227 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f56b0093-149f-4036-92ec-d363babbdc38 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:30.602920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f56b0093-149f-4036-92ec-d363babbdc38 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.615324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f56b0093-149f-4036-92ec-d363babbdc38 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.616006 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f56b0093-149f-4036-92ec-d363babbdc38 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:30.688151 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f56b0093-149f-4036-92ec-d363babbdc38 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117903 Sep 09 21:34:30.690034 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 383/788] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:34:30 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:30.701342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-871870d1-d930-4e02-b8cd-ab012cb54429 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:30.702052 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-871870d1-d930-4e02-b8cd-ab012cb54429 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:30.708934 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-871870d1-d930-4e02-b8cd-ab012cb54429 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.709425 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-871870d1-d930-4e02-b8cd-ab012cb54429 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.709865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-871870d1-d930-4e02-b8cd-ab012cb54429 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:30.710590 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-871870d1-d930-4e02-b8cd-ab012cb54429 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.711051 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-871870d1-d930-4e02-b8cd-ab012cb54429 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.711475 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-871870d1-d930-4e02-b8cd-ab012cb54429 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:30.736838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-90691b4f-6371-4488-a4c4-d9343deb36de tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Action: 'create', calling method: .version_select at 0x7f08166e88b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-225754611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV99S6RufOVlGIul/U9dU16lA6ZFE/B/LAnaod2w+hBaEG9vm5PQtrX1QR9lRNlF3tuRTE6npFfXjPeJw6Sx1tlwecnSfeavfCF9qV3coz9zHngKaE6deS4UioZOXDFVg=="}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:30.746243 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-871870d1-d930-4e02-b8cd-ab012cb54429 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:34:30.766634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-90691b4f-6371-4488-a4c4-d9343deb36de tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Getting quotas for project b9a36910972a4d87b508b918af36bbd5. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:34:30.776753 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-90691b4f-6371-4488-a4c4-d9343deb36de tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Getting quotas for user 691a25c97f4748119366c35dd4688765 and project b9a36910972a4d87b508b918af36bbd5. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:34:30.809725 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-90691b4f-6371-4488-a4c4-d9343deb36de tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.365278 Sep 09 21:34:30.818635 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 406/789] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 21:34:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:30.824173 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-44f2e636-3013-4943-9a51-629f681e80c1 req-4db68dea-f8b7-48e4-931f-73e2423138b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c0a8dd3-202a-407d-ae71-aab47f86d6f5", "tag": "7a98c16e-6360-4bb7-9f82-5a8d9091e05f"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:30.848744 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-44f2e636-3013-4943-9a51-629f681e80c1 req-4db68dea-f8b7-48e4-931f-73e2423138b6 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.849381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-44f2e636-3013-4943-9a51-629f681e80c1 req-4db68dea-f8b7-48e4-931f-73e2423138b6 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.850166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-44f2e636-3013-4943-9a51-629f681e80c1 req-4db68dea-f8b7-48e4-931f-73e2423138b6 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:30.863186 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-44f2e636-3013-4943-9a51-629f681e80c1 req-4db68dea-f8b7-48e4-931f-73e2423138b6 service nova] Creating event network-changed:7a98c16e-6360-4bb7-9f82-5a8d9091e05f for instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 on hv-cinder-85221 Sep 09 21:34:30.870927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-44f2e636-3013-4943-9a51-629f681e80c1 req-4db68dea-f8b7-48e4-931f-73e2423138b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052289 Sep 09 21:34:30.871981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 407/790] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:30.880153 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f61e4ab1-d44d-47aa-9b8f-59df0e784ea8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:30.880417 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-871870d1-d930-4e02-b8cd-ab012cb54429 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 204 len: 0 microversion: 2.1 time: 0.183345 Sep 09 21:34:30.881803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 384/791] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:34:30 2022] DELETE /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:34:30.885630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f61e4ab1-d44d-47aa-9b8f-59df0e784ea8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:30.893246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-68d316f8-046c-4c95-9036-01ddf7cb7d25 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:30.894131 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-68d316f8-046c-4c95-9036-01ddf7cb7d25 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:30.897061 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f61e4ab1-d44d-47aa-9b8f-59df0e784ea8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.897908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f61e4ab1-d44d-47aa-9b8f-59df0e784ea8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.898599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f61e4ab1-d44d-47aa-9b8f-59df0e784ea8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:30.899675 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f61e4ab1-d44d-47aa-9b8f-59df0e784ea8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.900370 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f61e4ab1-d44d-47aa-9b8f-59df0e784ea8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.900792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-68d316f8-046c-4c95-9036-01ddf7cb7d25 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.901290 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-68d316f8-046c-4c95-9036-01ddf7cb7d25 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.901434 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f61e4ab1-d44d-47aa-9b8f-59df0e784ea8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:30.901918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-68d316f8-046c-4c95-9036-01ddf7cb7d25 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:30.902628 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-68d316f8-046c-4c95-9036-01ddf7cb7d25 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.903378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-68d316f8-046c-4c95-9036-01ddf7cb7d25 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.918396 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-68d316f8-046c-4c95-9036-01ddf7cb7d25 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:30.944340 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f61e4ab1-d44d-47aa-9b8f-59df0e784ea8 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments/76b6dcf7-50eb-4d36-9753-444f1bc0a769" status: 200 len: 194 microversion: 2.1 time: 0.070623 Sep 09 21:34:30.952724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 408/792] 10.222.0.46 () {58 vars in 1413 bytes} [Fri Sep 9 21:34:30 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments/76b6dcf7-50eb-4d36-9753-444f1bc0a769 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:30.963795 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:30.964573 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:30.975840 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.978475 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.981065 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:30.982018 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:30.984785 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:30.985436 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:31.164866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-68d316f8-046c-4c95-9036-01ddf7cb7d25 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:31.174337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-68d316f8-046c-4c95-9036-01ddf7cb7d25 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.285508 Sep 09 21:34:31.192809 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 385/793] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:30 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:31.407601 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:31.419342 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:31.421375 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:31.423838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4344c3fa-8bde-4c90-9f7d-4ee77a5a39a4 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1717 microversion: 2.20 time: 0.466740 Sep 09 21:34:31.435574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 409/794] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:34:30 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1717 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:34:32.200542 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-bb6fd70a-61f9-4f45-921b-1c8eed02fcaa tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:32.201756 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-bb6fd70a-61f9-4f45-921b-1c8eed02fcaa tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:32.208734 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb6fd70a-61f9-4f45-921b-1c8eed02fcaa tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:32.209762 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb6fd70a-61f9-4f45-921b-1c8eed02fcaa tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:32.210270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb6fd70a-61f9-4f45-921b-1c8eed02fcaa tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:32.211116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb6fd70a-61f9-4f45-921b-1c8eed02fcaa tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:32.211904 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb6fd70a-61f9-4f45-921b-1c8eed02fcaa tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:32.212450 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bb6fd70a-61f9-4f45-921b-1c8eed02fcaa tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:32.453431 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-bb6fd70a-61f9-4f45-921b-1c8eed02fcaa tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:32.462428 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-bb6fd70a-61f9-4f45-921b-1c8eed02fcaa tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1566 microversion: 2.1 time: 0.265944 Sep 09 21:34:32.462988 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 386/795] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:32 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:32.500152 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b4bc72f6-72ec-413c-b611-9be714b1917c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b3bb462-7853-422a-835d-971ef894b5b0"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:32.503669 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b4bc72f6-72ec-413c-b611-9be714b1917c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:32.510935 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4bc72f6-72ec-413c-b611-9be714b1917c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:32.511426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4bc72f6-72ec-413c-b611-9be714b1917c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:32.511886 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4bc72f6-72ec-413c-b611-9be714b1917c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:32.512589 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4bc72f6-72ec-413c-b611-9be714b1917c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:32.513105 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4bc72f6-72ec-413c-b611-9be714b1917c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:32.513542 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b4bc72f6-72ec-413c-b611-9be714b1917c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:32.924624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b4bc72f6-72ec-413c-b611-9be714b1917c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "POST /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428173 Sep 09 21:34:32.927572 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 410/796] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:34:32 2022] POST /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:33.313037 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-e9bbb24c-2363-414b-af94-a96c3f5c9cbc req-c6947f10-4f37-4a0f-8ce8-60e9579f0bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0a8dd3-202a-407d-ae71-aab47f86d6f5", "name": "network-vif-deleted", "tag": "7a98c16e-6360-4bb7-9f82-5a8d9091e05f"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:33.324939 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-e9bbb24c-2363-414b-af94-a96c3f5c9cbc req-c6947f10-4f37-4a0f-8ce8-60e9579f0bdf service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:33.325452 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-e9bbb24c-2363-414b-af94-a96c3f5c9cbc req-c6947f10-4f37-4a0f-8ce8-60e9579f0bdf service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:33.325886 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-e9bbb24c-2363-414b-af94-a96c3f5c9cbc req-c6947f10-4f37-4a0f-8ce8-60e9579f0bdf service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:33.337637 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-e9bbb24c-2363-414b-af94-a96c3f5c9cbc req-c6947f10-4f37-4a0f-8ce8-60e9579f0bdf service nova] Creating event network-vif-deleted:7a98c16e-6360-4bb7-9f82-5a8d9091e05f for instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 on hv-cinder-85221 Sep 09 21:34:33.343327 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-e9bbb24c-2363-414b-af94-a96c3f5c9cbc req-c6947f10-4f37-4a0f-8ce8-60e9579f0bdf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033665 Sep 09 21:34:33.344340 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 387/797] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:33.495298 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-22f747d3-76c9-4d43-81c3-76178d42618e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:33.496045 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-22f747d3-76c9-4d43-81c3-76178d42618e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:33.502687 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f747d3-76c9-4d43-81c3-76178d42618e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:33.503275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f747d3-76c9-4d43-81c3-76178d42618e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:33.503629 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f747d3-76c9-4d43-81c3-76178d42618e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:33.504335 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f747d3-76c9-4d43-81c3-76178d42618e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:33.504873 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f747d3-76c9-4d43-81c3-76178d42618e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:33.505215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22f747d3-76c9-4d43-81c3-76178d42618e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:33.574030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-22f747d3-76c9-4d43-81c3-76178d42618e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469561e39c274301b16677d12cac3a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46e2167ee15481fab472e5b101c9c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:33.582754 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-22f747d3-76c9-4d43-81c3-76178d42618e tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 200 len: 1217 microversion: 2.1 time: 0.092136 Sep 09 21:34:33.583334 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 411/798] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:33 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:34.607515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:34.608249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] [instance: 1c0a8dd3-202a-407d-ae71-aab47f86d6f5] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:34.615460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:34.616099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:34.616712 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:34.617420 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:34.617878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:34.618305 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:34.644357 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] HTTP exception thrown: Instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 could not be found. Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Request method failure captured: Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 HTTP/1.1 Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG6_aOS0pZBI54FwAkS-pjDOsQG_eQb2vPkb1uZtmlnkS_MAEkn9IfoyiPTcjG0FW2AtzML-pHbqR5AIYnef-WQv8zCKnQBt_GZmgQxXs7h0cQ_3TnnpmP7o5pPNZMPgYS4usgSJP5Qds5CcB9U9KF30bPyAXFzqKthXe_m4xcVbTTuc Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: e46e2167ee15481fab472e5b101c9c60 Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-TestShelveInstance-57669950 Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:34:34.646032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e46e2167ee15481fab472e5b101c9c60", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e46e2167ee15481fab472e5b101c9c60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e46e2167ee15481fab472e5b101c9c60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e46e2167ee15481fab472e5b101c9c60"}]}] Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-TestShelveInstance-57669950 Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: e46e2167ee15481fab472e5b101c9c60 Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-TestShelveInstance-57669950 Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-TestShelveInstance-57669950-project Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 469561e39c274301b16677d12cac3a67 Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-TestShelveInstance-57669950-project Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 could not be found. Sep 09 21:34:34.647755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '1c0a8dd3-202a-407d-ae71-aab47f86d6f5'} Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 could not be found. Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:34:34.648668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 could not be found. Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 could not be found. Sep 09 21:34:34.649968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:34.651220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Returning 404 to user: Instance 1c0a8dd3-202a-407d-ae71-aab47f86d6f5 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:34:34.651220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-98a02efd-268d-4dbb-9a08-8cb31f514b4d tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5" status: 404 len: 111 microversion: 2.1 time: 0.044709 Sep 09 21:34:34.651220 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 388/799] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:34 2022] GET /compute/v2.1/servers/1c0a8dd3-202a-407d-ae71-aab47f86d6f5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:34:34.824100 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-12f794ef-1ec8-4f0e-8b1b-8613ebf70f53 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] Calling method '.version_select at 0x7f0812f5bd30>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:34.847742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-12f794ef-1ec8-4f0e-8b1b-8613ebf70f53 tempest-TestShelveInstance-57669950 tempest-TestShelveInstance-57669950-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-10145937" status: 202 len: 0 microversion: 2.1 time: 0.027325 Sep 09 21:34:34.860137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 412/800] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-10145937 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:34:40.588436 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-48185c7e-202e-41ab-bc41-8410ae52914b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:40.590595 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-48185c7e-202e-41ab-bc41-8410ae52914b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:40.597439 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48185c7e-202e-41ab-bc41-8410ae52914b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:40.598201 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48185c7e-202e-41ab-bc41-8410ae52914b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:40.598647 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48185c7e-202e-41ab-bc41-8410ae52914b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:40.599360 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48185c7e-202e-41ab-bc41-8410ae52914b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:40.599870 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48185c7e-202e-41ab-bc41-8410ae52914b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:40.600303 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48185c7e-202e-41ab-bc41-8410ae52914b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:40.648152 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-48185c7e-202e-41ab-bc41-8410ae52914b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063454 Sep 09 21:34:40.648831 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 389/801] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:34:40 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:40.792272 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a3966312-cfd2-4065-b8a4-252c1f8dbf1a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:40.792835 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a3966312-cfd2-4065-b8a4-252c1f8dbf1a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:40.795291 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=4 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:40.802394 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a3966312-cfd2-4065-b8a4-252c1f8dbf1a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:40.802884 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a3966312-cfd2-4065-b8a4-252c1f8dbf1a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:40.803320 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a3966312-cfd2-4065-b8a4-252c1f8dbf1a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:40.804249 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a3966312-cfd2-4065-b8a4-252c1f8dbf1a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:40.804708 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a3966312-cfd2-4065-b8a4-252c1f8dbf1a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:40.805136 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a3966312-cfd2-4065-b8a4-252c1f8dbf1a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:40.839453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a3966312-cfd2-4065-b8a4-252c1f8dbf1a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments/76b6dcf7-50eb-4d36-9753-444f1bc0a769" status: 200 len: 194 microversion: 2.1 time: 0.051112 Sep 09 21:34:40.840087 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 413/802] 10.222.0.46 () {58 vars in 1413 bytes} [Fri Sep 9 21:34:40 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments/76b6dcf7-50eb-4d36-9753-444f1bc0a769 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:40.851120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e3dd0514-accd-4f36-b06d-a99190838d55 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:40.851639 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e3dd0514-accd-4f36-b06d-a99190838d55 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:40.857535 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e3dd0514-accd-4f36-b06d-a99190838d55 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:40.858024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e3dd0514-accd-4f36-b06d-a99190838d55 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:40.858465 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e3dd0514-accd-4f36-b06d-a99190838d55 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:40.859149 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e3dd0514-accd-4f36-b06d-a99190838d55 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:40.859638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e3dd0514-accd-4f36-b06d-a99190838d55 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:40.860067 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e3dd0514-accd-4f36-b06d-a99190838d55 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:40.948187 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-e3dd0514-accd-4f36-b06d-a99190838d55 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lazy-loading 'services' on Instance uuid 48913637-6ede-4248-9948-b1d6c707a723 {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:34:41.024296 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e3dd0514-accd-4f36-b06d-a99190838d55 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments/76b6dcf7-50eb-4d36-9753-444f1bc0a769" status: 202 len: 0 microversion: 2.1 time: 0.176422 Sep 09 21:34:41.025060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 390/803] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:34:40 2022] DELETE /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments/76b6dcf7-50eb-4d36-9753-444f1bc0a769 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 21:34:43.231043 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ee10cab2-5818-46f2-bf1e-dd4275c29177 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:43.231603 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ee10cab2-5818-46f2-bf1e-dd4275c29177 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:43.238170 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee10cab2-5818-46f2-bf1e-dd4275c29177 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:43.238650 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee10cab2-5818-46f2-bf1e-dd4275c29177 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:43.239090 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee10cab2-5818-46f2-bf1e-dd4275c29177 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:43.239793 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee10cab2-5818-46f2-bf1e-dd4275c29177 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:43.240249 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee10cab2-5818-46f2-bf1e-dd4275c29177 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:43.240674 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee10cab2-5818-46f2-bf1e-dd4275c29177 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:43.242957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:43.272186 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ee10cab2-5818-46f2-bf1e-dd4275c29177 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments/5b3bb462-7853-422a-835d-971ef894b5b0" status: 200 len: 194 microversion: 2.1 time: 0.045087 Sep 09 21:34:43.272931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 414/804] 10.222.0.46 () {58 vars in 1413 bytes} [Fri Sep 9 21:34:43 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments/5b3bb462-7853-422a-835d-971ef894b5b0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:43.285305 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-71a469cc-2505-43bd-8e36-7c7989f8870f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:43.286446 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-71a469cc-2505-43bd-8e36-7c7989f8870f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:43.292567 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-71a469cc-2505-43bd-8e36-7c7989f8870f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:43.293055 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-71a469cc-2505-43bd-8e36-7c7989f8870f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:43.293503 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-71a469cc-2505-43bd-8e36-7c7989f8870f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:43.294186 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-71a469cc-2505-43bd-8e36-7c7989f8870f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:43.294644 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-71a469cc-2505-43bd-8e36-7c7989f8870f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:43.295073 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-71a469cc-2505-43bd-8e36-7c7989f8870f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:43.376792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-71a469cc-2505-43bd-8e36-7c7989f8870f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lazy-loading 'services' on Instance uuid 48913637-6ede-4248-9948-b1d6c707a723 {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:34:43.450436 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-71a469cc-2505-43bd-8e36-7c7989f8870f tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments/5b3bb462-7853-422a-835d-971ef894b5b0" status: 202 len: 0 microversion: 2.1 time: 0.169997 Sep 09 21:34:43.451268 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 391/805] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:34:43 2022] DELETE /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments/5b3bb462-7853-422a-835d-971ef894b5b0 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:34:44.642084 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9c5fdfd0-801c-4f64-a252-bd3e90163386 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:44.645545 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9c5fdfd0-801c-4f64-a252-bd3e90163386 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:44.652277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9c5fdfd0-801c-4f64-a252-bd3e90163386 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:44.652775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9c5fdfd0-801c-4f64-a252-bd3e90163386 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:44.653301 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9c5fdfd0-801c-4f64-a252-bd3e90163386 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:44.654006 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9c5fdfd0-801c-4f64-a252-bd3e90163386 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:44.654735 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9c5fdfd0-801c-4f64-a252-bd3e90163386 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:44.655344 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9c5fdfd0-801c-4f64-a252-bd3e90163386 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:44.689802 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9c5fdfd0-801c-4f64-a252-bd3e90163386 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051743 Sep 09 21:34:44.690415 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 415/806] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:34:44 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:34:44.815048 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d6292b9d-2d8c-41f5-b3e3-d4480ab2ecbc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:44.817287 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d6292b9d-2d8c-41f5-b3e3-d4480ab2ecbc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:44.823899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6292b9d-2d8c-41f5-b3e3-d4480ab2ecbc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:44.824387 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6292b9d-2d8c-41f5-b3e3-d4480ab2ecbc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:44.824824 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6292b9d-2d8c-41f5-b3e3-d4480ab2ecbc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:44.825512 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6292b9d-2d8c-41f5-b3e3-d4480ab2ecbc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:44.825972 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6292b9d-2d8c-41f5-b3e3-d4480ab2ecbc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:44.826399 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d6292b9d-2d8c-41f5-b3e3-d4480ab2ecbc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:44.855314 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d6292b9d-2d8c-41f5-b3e3-d4480ab2ecbc tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045309 Sep 09 21:34:44.855891 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 392/807] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:34:44 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:34:44.919864 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-84248755-ddc2-426d-8d98-38ba7911f9be tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:44.920361 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-84248755-ddc2-426d-8d98-38ba7911f9be tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:44.927162 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84248755-ddc2-426d-8d98-38ba7911f9be tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:44.927678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84248755-ddc2-426d-8d98-38ba7911f9be tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:44.928134 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84248755-ddc2-426d-8d98-38ba7911f9be tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:44.928822 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84248755-ddc2-426d-8d98-38ba7911f9be tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:44.929275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84248755-ddc2-426d-8d98-38ba7911f9be tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:44.929698 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84248755-ddc2-426d-8d98-38ba7911f9be tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:44.955162 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-84248755-ddc2-426d-8d98-38ba7911f9be tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:34:45.028513 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-84248755-ddc2-426d-8d98-38ba7911f9be tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 204 len: 0 microversion: 2.1 time: 0.112216 Sep 09 21:34:45.029086 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 416/808] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:34:44 2022] DELETE /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:34:45.037782 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-022edbef-4245-431b-a5a2-23e3504a7b1c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:45.038461 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-022edbef-4245-431b-a5a2-23e3504a7b1c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:45.044422 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-022edbef-4245-431b-a5a2-23e3504a7b1c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:45.044903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-022edbef-4245-431b-a5a2-23e3504a7b1c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:45.045336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-022edbef-4245-431b-a5a2-23e3504a7b1c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:45.046017 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-022edbef-4245-431b-a5a2-23e3504a7b1c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:45.046467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-022edbef-4245-431b-a5a2-23e3504a7b1c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:45.046889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-022edbef-4245-431b-a5a2-23e3504a7b1c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:45.178638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-022edbef-4245-431b-a5a2-23e3504a7b1c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:45.180928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=93,nova_cell1:INSERT=4 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:45.189307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-022edbef-4245-431b-a5a2-23e3504a7b1c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1675 microversion: 2.1 time: 0.154666 Sep 09 21:34:45.189882 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 393/809] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:45 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:46.213686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d852ec49-8ae8-4802-8e36-a2b8c505884a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:46.214381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d852ec49-8ae8-4802-8e36-a2b8c505884a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:46.221896 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d852ec49-8ae8-4802-8e36-a2b8c505884a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:46.222386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d852ec49-8ae8-4802-8e36-a2b8c505884a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:46.222824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d852ec49-8ae8-4802-8e36-a2b8c505884a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:46.223524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d852ec49-8ae8-4802-8e36-a2b8c505884a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:46.224004 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d852ec49-8ae8-4802-8e36-a2b8c505884a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:46.224428 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d852ec49-8ae8-4802-8e36-a2b8c505884a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:46.382867 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d852ec49-8ae8-4802-8e36-a2b8c505884a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:46.394125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d852ec49-8ae8-4802-8e36-a2b8c505884a tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1675 microversion: 2.1 time: 0.185510 Sep 09 21:34:46.394714 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 417/810] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:46 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:47.423920 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-eebb771b-9221-4149-9933-af1e28619ba9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:47.424547 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-eebb771b-9221-4149-9933-af1e28619ba9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:47.431478 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eebb771b-9221-4149-9933-af1e28619ba9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:47.431996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eebb771b-9221-4149-9933-af1e28619ba9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:47.432432 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eebb771b-9221-4149-9933-af1e28619ba9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:47.433147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eebb771b-9221-4149-9933-af1e28619ba9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:47.433603 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eebb771b-9221-4149-9933-af1e28619ba9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:47.434029 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-eebb771b-9221-4149-9933-af1e28619ba9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:47.566371 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-eebb771b-9221-4149-9933-af1e28619ba9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:47.573987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-eebb771b-9221-4149-9933-af1e28619ba9 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1675 microversion: 2.1 time: 0.155123 Sep 09 21:34:47.574542 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 394/811] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:47 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:48.597211 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-05c4298c-ab44-4c76-a760-03fb37862c1e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:48.597975 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-05c4298c-ab44-4c76-a760-03fb37862c1e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:48.605091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-05c4298c-ab44-4c76-a760-03fb37862c1e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:48.605593 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-05c4298c-ab44-4c76-a760-03fb37862c1e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:48.606038 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-05c4298c-ab44-4c76-a760-03fb37862c1e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:48.606745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-05c4298c-ab44-4c76-a760-03fb37862c1e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:48.607264 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-05c4298c-ab44-4c76-a760-03fb37862c1e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:48.607733 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-05c4298c-ab44-4c76-a760-03fb37862c1e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:48.685903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-8e53ed54-5b72-4a49-8b78-38dd2585aef9 req-cf7410b3-d987-4d71-a290-7900a4fe5b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48913637-6ede-4248-9948-b1d6c707a723", "name": "network-vif-deleted", "tag": "c214090d-afaf-4615-bb98-9180de1ac484"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:48.698863 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-8e53ed54-5b72-4a49-8b78-38dd2585aef9 req-cf7410b3-d987-4d71-a290-7900a4fe5b09 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:48.699761 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-8e53ed54-5b72-4a49-8b78-38dd2585aef9 req-cf7410b3-d987-4d71-a290-7900a4fe5b09 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:48.700385 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-8e53ed54-5b72-4a49-8b78-38dd2585aef9 req-cf7410b3-d987-4d71-a290-7900a4fe5b09 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:48.707157 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-05c4298c-ab44-4c76-a760-03fb37862c1e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c37b14f268f4180a618aa8eeefb5bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8ed5f414b947e2ab1815f5a775a2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:48.717098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-8e53ed54-5b72-4a49-8b78-38dd2585aef9 req-cf7410b3-d987-4d71-a290-7900a4fe5b09 service nova] Creating event network-vif-deleted:c214090d-afaf-4615-bb98-9180de1ac484 for instance 48913637-6ede-4248-9948-b1d6c707a723 on hv-cinder-85221 Sep 09 21:34:48.717338 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-05c4298c-ab44-4c76-a760-03fb37862c1e tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 200 len: 1607 microversion: 2.1 time: 0.123892 Sep 09 21:34:48.722518 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 418/812] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:48 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 1607 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:48.725990 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-8e53ed54-5b72-4a49-8b78-38dd2585aef9 req-cf7410b3-d987-4d71-a290-7900a4fe5b09 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046153 Sep 09 21:34:48.732073 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 395/813] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:34:49.747139 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:49.747786 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:49.754430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:49.754912 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:49.755347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:49.756063 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:49.756517 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:49.756938 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:49.771836 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] HTTP exception thrown: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Request method failure captured: Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 HTTP/1.1 Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG69EapCyCGGc3hRYbIGkqNpvuqGKT0tY758GEc6_AqVlDsSa8PrdS9dL4WWdw2DXO0n1FngWWkGfn9yOzAVAh0s-V1H5j6f7Ujb-K99btRI8HiJ9UD0Dxm9r0Niz9ZT82ndndjFVPLQ0atzfbdiHBYHE0ST9CTVbs5kEzqzVdTMj-c0 Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:34:49.774821 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bc8ed5f414b947e2ab1815f5a775a2c5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bc8ed5f414b947e2ab1815f5a775a2c5"}]}] Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 8c37b14f268f4180a618aa8eeefb5bc6 Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:49.776478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '48913637-6ede-4248-9948-b1d6c707a723'} Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:34:49.777439 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:49.779764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:34:49.781041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Returning 404 to user: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:34:49.781041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-45fc9dd3-83cd-487e-a76a-d3d7b5242f0c tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 404 len: 111 microversion: 2.1 time: 0.033037 Sep 09 21:34:49.781041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 419/814] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:49 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:34:49.790701 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8105aa4b-87c0-4373-8c52-27264ebf1f9d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '.version_select at 0x7f0812dba790>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:49.795232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8105aa4b-87c0-4373-8c52-27264ebf1f9d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [03f2d927-0d79-4950-a801-7972d3bfb21f] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 21:34:50.803209 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO oslo.messaging._drivers.impl_rabbit [None req-8105aa4b-87c0-4373-8c52-27264ebf1f9d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [03f2d927-0d79-4950-a801-7972d3bfb21f] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 38684. Sep 09 21:34:50.822156 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8105aa4b-87c0-4373-8c52-27264ebf1f9d tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438987703" status: 202 len: 0 microversion: 2.1 time: 1.035972 Sep 09 21:34:50.822753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 396/815] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 21:34:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438987703 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:34:53.687716 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:53.688484 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:53.691046 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:53.696344 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:53.696831 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:53.697268 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:53.697953 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:53.698409 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:53.698837 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:53.715696 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] HTTP exception thrown: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Request method failure captured: Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: DELETE /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 HTTP/1.1 Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG69EapCyCGGc3hRYbIGkqNpvuqGKT0tY758GEc6_AqVlDsSa8PrdS9dL4WWdw2DXO0n1FngWWkGfn9yOzAVAh0s-V1H5j6f7Ujb-K99btRI8HiJ9UD0Dxm9r0Niz9ZT82ndndjFVPLQ0atzfbdiHBYHE0ST9CTVbs5kEzqzVdTMj-c0 Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:34:53.717191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bc8ed5f414b947e2ab1815f5a775a2c5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bc8ed5f414b947e2ab1815f5a775a2c5"}]}] Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 8c37b14f268f4180a618aa8eeefb5bc6 Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:53.718777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '48913637-6ede-4248-9948-b1d6c707a723'} Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:34:53.720390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:53.721908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:34:53.723947 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Returning 404 to user: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:34:53.723947 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c02bd20f-a2fc-4a08-94c5-96b254b9317b tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 404 len: 111 microversion: 2.1 time: 0.034665 Sep 09 21:34:53.723947 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 420/816] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:34:53 2022] DELETE /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:34:53.727991 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:53.728721 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 48913637-6ede-4248-9948-b1d6c707a723] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:53.731174 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:34:53.737208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:53.737692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:53.738124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:53.738806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:53.739265 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:53.739720 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:53.754137 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] HTTP exception thrown: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Request method failure captured: Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 HTTP/1.1 Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG69EapCyCGGc3hRYbIGkqNpvuqGKT0tY758GEc6_AqVlDsSa8PrdS9dL4WWdw2DXO0n1FngWWkGfn9yOzAVAh0s-V1H5j6f7Ujb-K99btRI8HiJ9UD0Dxm9r0Niz9ZT82ndndjFVPLQ0atzfbdiHBYHE0ST9CTVbs5kEzqzVdTMj-c0 Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:34:53.755814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bc8ed5f414b947e2ab1815f5a775a2c5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bc8ed5f414b947e2ab1815f5a775a2c5"}]}] Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 8c37b14f268f4180a618aa8eeefb5bc6 Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:53.757358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '48913637-6ede-4248-9948-b1d6c707a723'} Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:34:53.758231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. Sep 09 21:34:53.759718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:53.760999 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Returning 404 to user: Instance 48913637-6ede-4248-9948-b1d6c707a723 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:34:53.760999 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d37255bc-98c8-4ec7-9aa2-e0bf4b75dba6 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723" status: 404 len: 111 microversion: 2.1 time: 0.033592 Sep 09 21:34:53.760999 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 397/817] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:53 2022] GET /compute/v2.1/servers/48913637-6ede-4248-9948-b1d6c707a723 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:34:54.288185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1425809935", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-225754611", "security_groups": [{"name": "tempest-secgroup-smoke-445796257"}], "block_device_mapping_v2": [{"uuid": "dcb90b8d-3948-4aa3-a77c-8db11f0f69aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f0bd4c9c-2c7c-4b69-bda5-7da8485a7c26"}]}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:34:54.399978 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.network.neutron [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] validate_networks() for [('f0bd4c9c-2c7c-4b69-bda5-7da8485a7c26', None, None, None, None, None)] {{(pid=120465) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:34:54.763445 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Flavor limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:34:54.764089 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Image limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:34:54.764356 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Flavor pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:34:54.764765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Image pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:34:54.765183 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:34:54.774010 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:54.774494 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:54.774931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:54.775691 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:54.776153 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:54.776579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:54.793042 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Getting quotas for project b9a36910972a4d87b508b918af36bbd5. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:34:54.796998 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Getting quotas for user 691a25c97f4748119366c35dd4688765 and project b9a36910972a4d87b508b918af36bbd5. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:34:54.852702 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Going to run 1 instances... {{(pid=120465) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:34:54.854775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dcb90b8d-3948-4aa3-a77c-8db11f0f69aa',volume_size=None,volume_type=None)] {{(pid=120465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:34:54.896323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:54.896893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:54.904357 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:54.904858 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:54.905297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:54.906082 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:54.906440 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:54.907011 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:54.920189 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] HTTP exception thrown: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Request method failure captured: Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 HTTP/1.1 Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG69EapCyCGGc3hRYbIGkqNpvuqGKT0tY758GEc6_AqVlDsSa8PrdS9dL4WWdw2DXO0n1FngWWkGfn9yOzAVAh0s-V1H5j6f7Ujb-K99btRI8HiJ9UD0Dxm9r0Niz9ZT82ndndjFVPLQ0atzfbdiHBYHE0ST9CTVbs5kEzqzVdTMj-c0 Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:34:54.921715 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bc8ed5f414b947e2ab1815f5a775a2c5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bc8ed5f414b947e2ab1815f5a775a2c5"}]}] Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 8c37b14f268f4180a618aa8eeefb5bc6 Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:34:54.923819 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '27906035-8bb1-450e-bb91-c40551e1a437'} Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:34:54.924592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:34:54.926270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:54.928201 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Returning 404 to user: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:34:54.928201 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c43bfb90-e8ed-4d35-82f9-ec29b0a58667 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 404 len: 111 microversion: 2.1 time: 0.031177 Sep 09 21:34:54.928201 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 398/818] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:34:54 2022] DELETE /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:34:54.931906 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:54.932508 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] [instance: 27906035-8bb1-450e-bb91-c40551e1a437] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:54.938903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:54.939560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:54.940269 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:54.941190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:54.941702 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:54.942270 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:54.956989 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] HTTP exception thrown: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Request method failure captured: Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 HTTP/1.1 Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG69EapCyCGGc3hRYbIGkqNpvuqGKT0tY758GEc6_AqVlDsSa8PrdS9dL4WWdw2DXO0n1FngWWkGfn9yOzAVAh0s-V1H5j6f7Ujb-K99btRI8HiJ9UD0Dxm9r0Niz9ZT82ndndjFVPLQ0atzfbdiHBYHE0ST9CTVbs5kEzqzVdTMj-c0 Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:34:54.959021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bc8ed5f414b947e2ab1815f5a775a2c5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bc8ed5f414b947e2ab1815f5a775a2c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bc8ed5f414b947e2ab1815f5a775a2c5"}]}] Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: bc8ed5f414b947e2ab1815f5a775a2c5 Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361409233 Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 8c37b14f268f4180a618aa8eeefb5bc6 Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeTestJSON-361409233-project Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:34:54.961902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '27906035-8bb1-450e-bb91-c40551e1a437'} Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:34:54.962899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. Sep 09 21:34:54.964389 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:34:54.966777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] Returning 404 to user: Instance 27906035-8bb1-450e-bb91-c40551e1a437 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:34:54.966777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c3b7f17d-1745-4b03-9b79-b99080b0ec58 tempest-AttachVolumeTestJSON-361409233 tempest-AttachVolumeTestJSON-361409233-project] 10.222.0.46 "GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437" status: 404 len: 111 microversion: 2.1 time: 0.032125 Sep 09 21:34:54.966777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 399/819] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:54 2022] GET /compute/v2.1/servers/27906035-8bb1-450e-bb91-c40551e1a437 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:34:55.000268 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-84a2719d-3550-4221-b8b6-6e1dcf09af85 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.715985 Sep 09 21:34:55.001203 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 421/820] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:34:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:34:55.012914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2cd62b10-5127-48fb-b284-41bb17d0e907 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:55.013813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2cd62b10-5127-48fb-b284-41bb17d0e907 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:55.073602 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2cd62b10-5127-48fb-b284-41bb17d0e907 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:55.081129 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2cd62b10-5127-48fb-b284-41bb17d0e907 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1094 microversion: 2.1 time: 0.072699 Sep 09 21:34:55.081688 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 400/821] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:55 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:56.104357 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d6211cc7-9c43-4a9a-acea-98639fdbfc8f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:56.105555 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d6211cc7-9c43-4a9a-acea-98639fdbfc8f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:56.181638 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d6211cc7-9c43-4a9a-acea-98639fdbfc8f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:56.189587 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d6211cc7-9c43-4a9a-acea-98639fdbfc8f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1094 microversion: 2.1 time: 0.089503 Sep 09 21:34:56.190163 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 422/822] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:56 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:57.213230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-801a85c0-2fc0-4f66-b060-c512e185697b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:57.214788 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-801a85c0-2fc0-4f66-b060-c512e185697b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:57.300323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-801a85c0-2fc0-4f66-b060-c512e185697b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:57.308640 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-801a85c0-2fc0-4f66-b060-c512e185697b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1094 microversion: 2.1 time: 0.099692 Sep 09 21:34:57.309289 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 401/823] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:57 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:58.335634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0eb4afdd-babc-4b15-84ec-70027ec128f9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:58.337299 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0eb4afdd-babc-4b15-84ec-70027ec128f9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:58.426198 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0eb4afdd-babc-4b15-84ec-70027ec128f9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:58.435441 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0eb4afdd-babc-4b15-84ec-70027ec128f9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1094 microversion: 2.1 time: 0.107841 Sep 09 21:34:58.437401 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 423/824] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:58 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:34:59.458342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-325be8bf-4618-4900-88b2-b86f4cf15f97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:34:59.459499 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-325be8bf-4618-4900-88b2-b86f4cf15f97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:34:59.466468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-325be8bf-4618-4900-88b2-b86f4cf15f97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:59.466959 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-325be8bf-4618-4900-88b2-b86f4cf15f97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:59.467393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-325be8bf-4618-4900-88b2-b86f4cf15f97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:59.468205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-325be8bf-4618-4900-88b2-b86f4cf15f97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:34:59.468705 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-325be8bf-4618-4900-88b2-b86f4cf15f97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:34:59.469312 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-325be8bf-4618-4900-88b2-b86f4cf15f97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:34:59.538993 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-325be8bf-4618-4900-88b2-b86f4cf15f97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:34:59.549488 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-325be8bf-4618-4900-88b2-b86f4cf15f97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1144 microversion: 2.1 time: 0.095046 Sep 09 21:34:59.550054 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 402/825] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:34:59 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:00.573006 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-dee83dbe-2b42-4f8d-b5c8-3d7e0ed94667 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:00.573727 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-dee83dbe-2b42-4f8d-b5c8-3d7e0ed94667 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:00.580506 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dee83dbe-2b42-4f8d-b5c8-3d7e0ed94667 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:00.581398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dee83dbe-2b42-4f8d-b5c8-3d7e0ed94667 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:00.581930 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dee83dbe-2b42-4f8d-b5c8-3d7e0ed94667 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:00.582818 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dee83dbe-2b42-4f8d-b5c8-3d7e0ed94667 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:00.583283 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dee83dbe-2b42-4f8d-b5c8-3d7e0ed94667 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:00.583914 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dee83dbe-2b42-4f8d-b5c8-3d7e0ed94667 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:00.676977 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-dee83dbe-2b42-4f8d-b5c8-3d7e0ed94667 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:00.688611 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-dee83dbe-2b42-4f8d-b5c8-3d7e0ed94667 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1210 microversion: 2.1 time: 0.119209 Sep 09 21:35:00.700328 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 424/826] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:00 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:01.717659 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6f46dca8-87f9-48c9-acd3-bb567209bdcd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:01.718886 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6f46dca8-87f9-48c9-acd3-bb567209bdcd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:01.726362 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f46dca8-87f9-48c9-acd3-bb567209bdcd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:01.727084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f46dca8-87f9-48c9-acd3-bb567209bdcd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:01.727718 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f46dca8-87f9-48c9-acd3-bb567209bdcd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:01.728588 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f46dca8-87f9-48c9-acd3-bb567209bdcd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:01.729211 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f46dca8-87f9-48c9-acd3-bb567209bdcd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:01.729827 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f46dca8-87f9-48c9-acd3-bb567209bdcd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:01.889186 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6f46dca8-87f9-48c9-acd3-bb567209bdcd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:01.897934 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6f46dca8-87f9-48c9-acd3-bb567209bdcd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.184615 Sep 09 21:35:01.898970 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 403/827] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:01 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:01.904378 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-f58582da-3ed3-4acd-87c2-012703fc692a req-a0d8aea0-9fef-4b59-87b7-191e261d0c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc844a55-4e91-445f-8de9-c8ff4e9af66b", "tag": "e8928d59-873a-4d3e-8f9d-f1d136839c2e"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:35:01.919239 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-f58582da-3ed3-4acd-87c2-012703fc692a req-a0d8aea0-9fef-4b59-87b7-191e261d0c4e service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:01.920115 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-f58582da-3ed3-4acd-87c2-012703fc692a req-a0d8aea0-9fef-4b59-87b7-191e261d0c4e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:01.920844 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-f58582da-3ed3-4acd-87c2-012703fc692a req-a0d8aea0-9fef-4b59-87b7-191e261d0c4e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:01.936082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-f58582da-3ed3-4acd-87c2-012703fc692a req-a0d8aea0-9fef-4b59-87b7-191e261d0c4e service nova] Creating event network-changed:e8928d59-873a-4d3e-8f9d-f1d136839c2e for instance bc844a55-4e91-445f-8de9-c8ff4e9af66b on hv-cinder-85221 Sep 09 21:35:01.943746 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-f58582da-3ed3-4acd-87c2-012703fc692a req-a0d8aea0-9fef-4b59-87b7-191e261d0c4e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043620 Sep 09 21:35:01.944844 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 425/828] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:35:02.923517 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-335af4fb-75b4-4a2b-9879-6b5a6729d117 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:02.924349 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-335af4fb-75b4-4a2b-9879-6b5a6729d117 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:02.931426 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-335af4fb-75b4-4a2b-9879-6b5a6729d117 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:02.931944 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-335af4fb-75b4-4a2b-9879-6b5a6729d117 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:02.932378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-335af4fb-75b4-4a2b-9879-6b5a6729d117 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:02.933066 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-335af4fb-75b4-4a2b-9879-6b5a6729d117 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:02.933518 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-335af4fb-75b4-4a2b-9879-6b5a6729d117 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:02.933938 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-335af4fb-75b4-4a2b-9879-6b5a6729d117 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:03.067145 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-335af4fb-75b4-4a2b-9879-6b5a6729d117 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:03.074860 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-335af4fb-75b4-4a2b-9879-6b5a6729d117 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.156564 Sep 09 21:35:03.075424 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 404/829] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:02 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:04.100058 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9239f69b-4f02-4c42-b964-4f8a83309145 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:04.100670 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9239f69b-4f02-4c42-b964-4f8a83309145 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:04.107157 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9239f69b-4f02-4c42-b964-4f8a83309145 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:04.107650 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9239f69b-4f02-4c42-b964-4f8a83309145 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:04.108269 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9239f69b-4f02-4c42-b964-4f8a83309145 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:04.109011 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9239f69b-4f02-4c42-b964-4f8a83309145 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:04.110740 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9239f69b-4f02-4c42-b964-4f8a83309145 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:04.111303 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9239f69b-4f02-4c42-b964-4f8a83309145 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:04.245398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9239f69b-4f02-4c42-b964-4f8a83309145 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:04.253453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9239f69b-4f02-4c42-b964-4f8a83309145 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.157644 Sep 09 21:35:04.254004 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 426/830] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:04 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:05.276316 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6a0585d7-8664-4f6b-afb5-d67bafea27e9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:05.276933 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6a0585d7-8664-4f6b-afb5-d67bafea27e9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:05.284758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a0585d7-8664-4f6b-afb5-d67bafea27e9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:05.285246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a0585d7-8664-4f6b-afb5-d67bafea27e9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:05.285686 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a0585d7-8664-4f6b-afb5-d67bafea27e9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:05.286368 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a0585d7-8664-4f6b-afb5-d67bafea27e9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:05.286822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a0585d7-8664-4f6b-afb5-d67bafea27e9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:05.287244 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a0585d7-8664-4f6b-afb5-d67bafea27e9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:05.422019 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6a0585d7-8664-4f6b-afb5-d67bafea27e9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:05.429698 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6a0585d7-8664-4f6b-afb5-d67bafea27e9 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.157246 Sep 09 21:35:05.430259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 405/831] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:05 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:06.452297 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d4f2ce25-7ed2-45f2-adde-d409d55e2b90 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:06.453485 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d4f2ce25-7ed2-45f2-adde-d409d55e2b90 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:06.455463 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:06.461410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4f2ce25-7ed2-45f2-adde-d409d55e2b90 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:06.461926 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4f2ce25-7ed2-45f2-adde-d409d55e2b90 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:06.462365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4f2ce25-7ed2-45f2-adde-d409d55e2b90 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:06.463050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4f2ce25-7ed2-45f2-adde-d409d55e2b90 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:06.463505 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4f2ce25-7ed2-45f2-adde-d409d55e2b90 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:06.463959 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4f2ce25-7ed2-45f2-adde-d409d55e2b90 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:06.599201 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d4f2ce25-7ed2-45f2-adde-d409d55e2b90 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:06.606841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d4f2ce25-7ed2-45f2-adde-d409d55e2b90 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.158503 Sep 09 21:35:06.607400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 427/832] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:06 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:07.630131 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9e8a4d77-9ddb-4e24-8f8a-bd691b1284e8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:07.630770 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9e8a4d77-9ddb-4e24-8f8a-bd691b1284e8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:07.633305 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=4 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:07.638661 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e8a4d77-9ddb-4e24-8f8a-bd691b1284e8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:07.639150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e8a4d77-9ddb-4e24-8f8a-bd691b1284e8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:07.639616 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e8a4d77-9ddb-4e24-8f8a-bd691b1284e8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:07.640307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e8a4d77-9ddb-4e24-8f8a-bd691b1284e8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:07.641011 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e8a4d77-9ddb-4e24-8f8a-bd691b1284e8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:07.641532 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9e8a4d77-9ddb-4e24-8f8a-bd691b1284e8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:07.770793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-9e8a4d77-9ddb-4e24-8f8a-bd691b1284e8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:07.778393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9e8a4d77-9ddb-4e24-8f8a-bd691b1284e8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.152130 Sep 09 21:35:07.779211 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 406/833] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:07 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:08.802372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e8a8c1a1-3811-4828-bcaa-4beacc006a18 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:08.802956 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e8a8c1a1-3811-4828-bcaa-4beacc006a18 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:08.805292 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=10 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:08.811252 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8a8c1a1-3811-4828-bcaa-4beacc006a18 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:08.811771 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8a8c1a1-3811-4828-bcaa-4beacc006a18 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:08.812986 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8a8c1a1-3811-4828-bcaa-4beacc006a18 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:08.813877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8a8c1a1-3811-4828-bcaa-4beacc006a18 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:08.814343 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8a8c1a1-3811-4828-bcaa-4beacc006a18 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:08.814778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8a8c1a1-3811-4828-bcaa-4beacc006a18 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:08.946649 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e8a8c1a1-3811-4828-bcaa-4beacc006a18 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:08.954583 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e8a8c1a1-3811-4828-bcaa-4beacc006a18 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.156206 Sep 09 21:35:08.955142 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 428/834] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:08 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:09.976844 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2bcc6901-e231-499e-a27b-e69e5776f890 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:09.977460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2bcc6901-e231-499e-a27b-e69e5776f890 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:09.984572 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bcc6901-e231-499e-a27b-e69e5776f890 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:09.985134 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bcc6901-e231-499e-a27b-e69e5776f890 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:09.985574 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bcc6901-e231-499e-a27b-e69e5776f890 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:09.986262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bcc6901-e231-499e-a27b-e69e5776f890 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:09.986719 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bcc6901-e231-499e-a27b-e69e5776f890 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:09.987144 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bcc6901-e231-499e-a27b-e69e5776f890 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:10.126031 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2bcc6901-e231-499e-a27b-e69e5776f890 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:10.133664 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2bcc6901-e231-499e-a27b-e69e5776f890 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.160633 Sep 09 21:35:10.134226 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 407/835] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:09 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:11.156738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-950743ef-c451-40dc-b3a1-1dd5e5ee0af8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:11.157382 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-950743ef-c451-40dc-b3a1-1dd5e5ee0af8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:11.163756 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-950743ef-c451-40dc-b3a1-1dd5e5ee0af8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:11.164243 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-950743ef-c451-40dc-b3a1-1dd5e5ee0af8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:11.164686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-950743ef-c451-40dc-b3a1-1dd5e5ee0af8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:11.165386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-950743ef-c451-40dc-b3a1-1dd5e5ee0af8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:11.165828 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-950743ef-c451-40dc-b3a1-1dd5e5ee0af8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:11.166254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-950743ef-c451-40dc-b3a1-1dd5e5ee0af8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:11.299717 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-950743ef-c451-40dc-b3a1-1dd5e5ee0af8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:11.307334 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-950743ef-c451-40dc-b3a1-1dd5e5ee0af8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.154761 Sep 09 21:35:11.307937 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 429/836] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:11 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:12.334332 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b11b6e9d-bb84-4046-adf3-7dc7ad98b97c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:12.334960 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b11b6e9d-bb84-4046-adf3-7dc7ad98b97c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:12.342337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b11b6e9d-bb84-4046-adf3-7dc7ad98b97c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:12.342896 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b11b6e9d-bb84-4046-adf3-7dc7ad98b97c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:12.343665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b11b6e9d-bb84-4046-adf3-7dc7ad98b97c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:12.344723 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b11b6e9d-bb84-4046-adf3-7dc7ad98b97c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:12.345196 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b11b6e9d-bb84-4046-adf3-7dc7ad98b97c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:12.345665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b11b6e9d-bb84-4046-adf3-7dc7ad98b97c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:12.484783 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b11b6e9d-bb84-4046-adf3-7dc7ad98b97c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:12.492548 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b11b6e9d-bb84-4046-adf3-7dc7ad98b97c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.166058 Sep 09 21:35:12.493100 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 408/837] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:12 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:13.516035 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d9ab8f4b-79ce-43d4-807b-3f0d47f5bc97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:13.516755 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d9ab8f4b-79ce-43d4-807b-3f0d47f5bc97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:13.523343 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d9ab8f4b-79ce-43d4-807b-3f0d47f5bc97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:13.523865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d9ab8f4b-79ce-43d4-807b-3f0d47f5bc97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:13.524315 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d9ab8f4b-79ce-43d4-807b-3f0d47f5bc97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:13.525009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d9ab8f4b-79ce-43d4-807b-3f0d47f5bc97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:13.525472 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d9ab8f4b-79ce-43d4-807b-3f0d47f5bc97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:13.525903 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d9ab8f4b-79ce-43d4-807b-3f0d47f5bc97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:13.530431 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:13.667661 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d9ab8f4b-79ce-43d4-807b-3f0d47f5bc97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:13.675890 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d9ab8f4b-79ce-43d4-807b-3f0d47f5bc97 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.164631 Sep 09 21:35:13.676461 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 430/838] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:13 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:14.330315 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-3f56caa9-f1dd-42b6-abad-8debebb8c3c8 req-b26e1c21-c12d-4cf4-a9e7-20a52fbdb70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc844a55-4e91-445f-8de9-c8ff4e9af66b", "name": "network-vif-plugged", "status": "completed", "tag": "e8928d59-873a-4d3e-8f9d-f1d136839c2e"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:35:14.340501 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-3f56caa9-f1dd-42b6-abad-8debebb8c3c8 req-b26e1c21-c12d-4cf4-a9e7-20a52fbdb70d service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:14.340987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-3f56caa9-f1dd-42b6-abad-8debebb8c3c8 req-b26e1c21-c12d-4cf4-a9e7-20a52fbdb70d service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:14.341423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-3f56caa9-f1dd-42b6-abad-8debebb8c3c8 req-b26e1c21-c12d-4cf4-a9e7-20a52fbdb70d service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:14.353247 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-3f56caa9-f1dd-42b6-abad-8debebb8c3c8 req-b26e1c21-c12d-4cf4-a9e7-20a52fbdb70d service nova] Creating event network-vif-plugged:e8928d59-873a-4d3e-8f9d-f1d136839c2e for instance bc844a55-4e91-445f-8de9-c8ff4e9af66b on hv-cinder-85221 Sep 09 21:35:14.359291 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-3f56caa9-f1dd-42b6-abad-8debebb8c3c8 req-b26e1c21-c12d-4cf4-a9e7-20a52fbdb70d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032447 Sep 09 21:35:14.359981 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 409/839] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:35:14.698250 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f51b4ff2-1423-41bd-afa9-59b20cebe023 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:14.698876 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f51b4ff2-1423-41bd-afa9-59b20cebe023 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:14.705336 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51b4ff2-1423-41bd-afa9-59b20cebe023 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:14.705838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51b4ff2-1423-41bd-afa9-59b20cebe023 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:14.706281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51b4ff2-1423-41bd-afa9-59b20cebe023 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:14.706983 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51b4ff2-1423-41bd-afa9-59b20cebe023 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:14.707710 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51b4ff2-1423-41bd-afa9-59b20cebe023 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:14.708150 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f51b4ff2-1423-41bd-afa9-59b20cebe023 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:14.856736 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f51b4ff2-1423-41bd-afa9-59b20cebe023 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:14.866846 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f51b4ff2-1423-41bd-afa9-59b20cebe023 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.172439 Sep 09 21:35:14.867405 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 431/840] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:14 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:15.890700 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-79a70081-fa1b-455a-bd59-3393d8ee1abd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:15.891513 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-79a70081-fa1b-455a-bd59-3393d8ee1abd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:15.898023 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-79a70081-fa1b-455a-bd59-3393d8ee1abd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:15.898512 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-79a70081-fa1b-455a-bd59-3393d8ee1abd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:15.899085 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-79a70081-fa1b-455a-bd59-3393d8ee1abd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:15.899900 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-79a70081-fa1b-455a-bd59-3393d8ee1abd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:15.900362 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-79a70081-fa1b-455a-bd59-3393d8ee1abd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:15.900902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-79a70081-fa1b-455a-bd59-3393d8ee1abd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:16.045349 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-79a70081-fa1b-455a-bd59-3393d8ee1abd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:16.053959 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-79a70081-fa1b-455a-bd59-3393d8ee1abd tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1265 microversion: 2.1 time: 0.167588 Sep 09 21:35:16.054521 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 410/841] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:15 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:17.076385 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9b3f62d6-7b80-4293-8b30-468c8637533a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:17.076916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9b3f62d6-7b80-4293-8b30-468c8637533a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:17.083684 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b3f62d6-7b80-4293-8b30-468c8637533a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:17.084077 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b3f62d6-7b80-4293-8b30-468c8637533a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:17.084544 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b3f62d6-7b80-4293-8b30-468c8637533a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:17.085241 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b3f62d6-7b80-4293-8b30-468c8637533a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:17.085782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b3f62d6-7b80-4293-8b30-468c8637533a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:17.086212 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b3f62d6-7b80-4293-8b30-468c8637533a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:17.231114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9b3f62d6-7b80-4293-8b30-468c8637533a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:17.239272 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9b3f62d6-7b80-4293-8b30-468c8637533a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1451 microversion: 2.1 time: 0.166638 Sep 09 21:35:17.239758 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 432/842] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:17 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:17.261671 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f9d2a740-66d2-4c03-86dc-5209e05be4d8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:17.262191 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f9d2a740-66d2-4c03-86dc-5209e05be4d8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:17.269076 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9d2a740-66d2-4c03-86dc-5209e05be4d8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:17.269562 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9d2a740-66d2-4c03-86dc-5209e05be4d8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:17.270277 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9d2a740-66d2-4c03-86dc-5209e05be4d8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:17.270685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9d2a740-66d2-4c03-86dc-5209e05be4d8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:17.271141 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9d2a740-66d2-4c03-86dc-5209e05be4d8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:17.271594 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f9d2a740-66d2-4c03-86dc-5209e05be4d8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:17.407776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-f9d2a740-66d2-4c03-86dc-5209e05be4d8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:17.418769 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f9d2a740-66d2-4c03-86dc-5209e05be4d8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1451 microversion: 2.1 time: 0.161158 Sep 09 21:35:17.419339 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 411/843] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:17 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:19.464711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-ca557eeb-dbe4-4db6-b853-1d20e7426cce req-f4d07313-c3ac-4787-982d-eb37a0b80c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc844a55-4e91-445f-8de9-c8ff4e9af66b", "tag": "e8928d59-873a-4d3e-8f9d-f1d136839c2e"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:35:19.476386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-ca557eeb-dbe4-4db6-b853-1d20e7426cce req-f4d07313-c3ac-4787-982d-eb37a0b80c71 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:19.476931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-ca557eeb-dbe4-4db6-b853-1d20e7426cce req-f4d07313-c3ac-4787-982d-eb37a0b80c71 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:19.477549 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-ca557eeb-dbe4-4db6-b853-1d20e7426cce req-f4d07313-c3ac-4787-982d-eb37a0b80c71 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:19.490448 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-ca557eeb-dbe4-4db6-b853-1d20e7426cce req-f4d07313-c3ac-4787-982d-eb37a0b80c71 service nova] Creating event network-changed:e8928d59-873a-4d3e-8f9d-f1d136839c2e for instance bc844a55-4e91-445f-8de9-c8ff4e9af66b on hv-cinder-85221 Sep 09 21:35:19.495927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-ca557eeb-dbe4-4db6-b853-1d20e7426cce req-f4d07313-c3ac-4787-982d-eb37a0b80c71 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034599 Sep 09 21:35:19.496867 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 433/844] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:35:35.605761 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b0c46058-8eab-41d6-8510-69529417897d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:35.607910 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b0c46058-8eab-41d6-8510-69529417897d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:35.610045 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=33 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:35.611608 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=71 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:35.613297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:35:35.613438 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Fri Sep 9 21:35:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/os-volume_attachments (ip 10.222.0.46) !!! Sep 09 21:35:35.622772 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b0c46058-8eab-41d6-8510-69529417897d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:35.623264 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b0c46058-8eab-41d6-8510-69529417897d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:35.623739 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b0c46058-8eab-41d6-8510-69529417897d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:35.624442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b0c46058-8eab-41d6-8510-69529417897d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:35.624903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b0c46058-8eab-41d6-8510-69529417897d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:35.625332 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b0c46058-8eab-41d6-8510-69529417897d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:35.658465 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b0c46058-8eab-41d6-8510-69529417897d tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056692 Sep 09 21:35:35.659035 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 412/845] 10.222.0.46 () {60 vars in 1343 bytes} [Fri Sep 9 21:35:35 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:35.722295 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:35.723022 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=19 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:35.727866 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2211d09a-f38c-4a88-8661-a61f732d3c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:35.728455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2211d09a-f38c-4a88-8661-a61f732d3c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:35.736215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2211d09a-f38c-4a88-8661-a61f732d3c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:35.736710 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2211d09a-f38c-4a88-8661-a61f732d3c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:35.737155 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2211d09a-f38c-4a88-8661-a61f732d3c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:35.737859 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2211d09a-f38c-4a88-8661-a61f732d3c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:35.738323 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2211d09a-f38c-4a88-8661-a61f732d3c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:35.738750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2211d09a-f38c-4a88-8661-a61f732d3c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:35.764814 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2211d09a-f38c-4a88-8661-a61f732d3c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:35:35.846992 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2211d09a-f38c-4a88-8661-a61f732d3c02 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 204 len: 0 microversion: 2.20 time: 0.126045 Sep 09 21:35:35.847755 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 434/846] 10.222.0.46 () {60 vars in 1280 bytes} [Fri Sep 9 21:35:35 2022] DELETE /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 21:35:35.856632 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:35.857281 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:35.864259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:35.864750 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:35.865181 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:35.865896 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:35.867877 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:35.868325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:36.171742 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:36.180456 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:36.181905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:36.183065 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6b9b458b-5e7a-468a-bd13-7f054c384254 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.330979 Sep 09 21:35:36.183644 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 413/847] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:35:35 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:35:37.212436 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:37.213164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:37.220164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:37.220954 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:37.221399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:37.222093 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:37.222549 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:37.222975 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:37.414223 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:37.422209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:37.423854 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:37.424999 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-aec42671-91c6-4876-8430-9dd999d4f9ae tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.216878 Sep 09 21:35:37.425549 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 435/848] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:35:37 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:35:38.449792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:38.450669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:38.459406 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:38.459928 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:38.460365 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:38.461060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:38.461517 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:38.461943 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:38.597585 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:38.605697 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:38.607147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85a24cb16a864a03920ccb359c13ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c332dc5c44eee9c7c81787a435533', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:38.608338 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d5f651c8-d668-4aed-9b20-f3d5a3973e62 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 200 len: 1723 microversion: 2.20 time: 0.162600 Sep 09 21:35:38.609213 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 414/849] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:35:38 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:35:38.942201 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-40ce8f3e-8bc9-4834-a0cb-5320eecde10f req-47049310-0998-42d3-8ef6-f347ace18bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4346b807-8641-4458-98d2-c1072c799994", "name": "network-vif-deleted", "tag": "d23cedea-0322-45bd-8b29-1ff96462c426"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:35:38.955810 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-40ce8f3e-8bc9-4834-a0cb-5320eecde10f req-47049310-0998-42d3-8ef6-f347ace18bf5 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:38.956689 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-40ce8f3e-8bc9-4834-a0cb-5320eecde10f req-47049310-0998-42d3-8ef6-f347ace18bf5 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:38.957135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-40ce8f3e-8bc9-4834-a0cb-5320eecde10f req-47049310-0998-42d3-8ef6-f347ace18bf5 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:38.995815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-40ce8f3e-8bc9-4834-a0cb-5320eecde10f req-47049310-0998-42d3-8ef6-f347ace18bf5 service nova] Creating event network-vif-deleted:d23cedea-0322-45bd-8b29-1ff96462c426 for instance 4346b807-8641-4458-98d2-c1072c799994 on hv-cinder-85221 Sep 09 21:35:39.011186 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-40ce8f3e-8bc9-4834-a0cb-5320eecde10f req-47049310-0998-42d3-8ef6-f347ace18bf5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073856 Sep 09 21:35:39.012215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 436/850] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:35:39.644150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:39.645206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:39.651757 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:39.652239 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:39.652873 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:39.653829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:39.654349 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:39.654770 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:39.668759 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] HTTP exception thrown: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Request method failure captured: Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 HTTP/1.1 Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG69DEBaOH-ADhfDFLp0KwqSisXNdgpiiCcdfB4pvSWzDezyPN5xBtrf0MT9eOsBxzaHUlTQX1byBm0-QhHNQdInL9M3jiwAhvshc4sZuLAitiHd5Srhf-k_0qSjPLCmQiNaLBcK7LA49G7fXAWzRH4UbqBkCZhD8jXRxIHEYpmFZCvA Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:35:39.670751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec1c332dc5c44eee9c7c81787a435533", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec1c332dc5c44eee9c7c81787a435533"}]}] Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 85a24cb16a864a03920ccb359c13ec79 Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:39.672530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '4346b807-8641-4458-98d2-c1072c799994'} Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:35:39.677793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:39.680416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:39.681772 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Returning 404 to user: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:35:39.681772 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0126393b-0e74-4483-bf07-024b4e04adb7 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 404 len: 111 microversion: 2.20 time: 0.040308 Sep 09 21:35:39.681772 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 415/851] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:35:39 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:35:39.689171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-eb3ac756-3812-4df4-8ad0-81c2c3f0af0e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '.version_select at 0x7f08167cc820>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:39.709498 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-eb3ac756-3812-4df4-8ad0-81c2c3f0af0e tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653181110" status: 204 len: 0 microversion: 2.20 time: 0.029218 Sep 09 21:35:39.710081 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 437/852] 10.222.0.46 () {60 vars in 1259 bytes} [Fri Sep 9 21:35:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653181110 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 21:35:41.547021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:41.548078 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:41.559749 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:41.560238 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:41.560776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:41.561423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:41.561882 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:41.562311 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:41.577206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] HTTP exception thrown: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Request method failure captured: Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 HTTP/1.1 Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG69DEBaOH-ADhfDFLp0KwqSisXNdgpiiCcdfB4pvSWzDezyPN5xBtrf0MT9eOsBxzaHUlTQX1byBm0-QhHNQdInL9M3jiwAhvshc4sZuLAitiHd5Srhf-k_0qSjPLCmQiNaLBcK7LA49G7fXAWzRH4UbqBkCZhD8jXRxIHEYpmFZCvA Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:35:41.578753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec1c332dc5c44eee9c7c81787a435533", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec1c332dc5c44eee9c7c81787a435533"}]}] Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 85a24cb16a864a03920ccb359c13ec79 Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:41.580764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '4346b807-8641-4458-98d2-c1072c799994'} Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:35:41.581570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:41.582771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:41.584005 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Returning 404 to user: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:35:41.584005 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f90e9ce3-bf3a-426b-8260-f3fb2d3187ed tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 404 len: 111 microversion: 2.20 time: 0.037463 Sep 09 21:35:41.584005 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 416/853] 10.222.0.46 () {60 vars in 1280 bytes} [Fri Sep 9 21:35:41 2022] DELETE /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:35:41.589958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:41.590679 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: 4346b807-8641-4458-98d2-c1072c799994] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:41.597238 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:41.597722 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:41.598158 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:41.598841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:41.599291 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:41.599743 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:41.613780 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] HTTP exception thrown: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Request method failure captured: Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 HTTP/1.1 Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG69DEBaOH-ADhfDFLp0KwqSisXNdgpiiCcdfB4pvSWzDezyPN5xBtrf0MT9eOsBxzaHUlTQX1byBm0-QhHNQdInL9M3jiwAhvshc4sZuLAitiHd5Srhf-k_0qSjPLCmQiNaLBcK7LA49G7fXAWzRH4UbqBkCZhD8jXRxIHEYpmFZCvA Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:35:41.615497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec1c332dc5c44eee9c7c81787a435533", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec1c332dc5c44eee9c7c81787a435533"}]}] Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 85a24cb16a864a03920ccb359c13ec79 Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:41.617188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '4346b807-8641-4458-98d2-c1072c799994'} Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:35:41.618091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. Sep 09 21:35:41.619564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:35:41.620916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Returning 404 to user: Instance 4346b807-8641-4458-98d2-c1072c799994 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:35:41.620916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7e0f47fb-baed-470e-9677-6879a5614451 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994" status: 404 len: 111 microversion: 2.20 time: 0.031322 Sep 09 21:35:41.620916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 438/854] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:35:41 2022] GET /compute/v2.1/servers/4346b807-8641-4458-98d2-c1072c799994 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:35:42.763710 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:42.764203 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:42.771190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:42.771705 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:42.772136 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:42.772823 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:42.773275 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:42.773693 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:42.786916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] HTTP exception thrown: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Request method failure captured: Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 HTTP/1.1 Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG69DEBaOH-ADhfDFLp0KwqSisXNdgpiiCcdfB4pvSWzDezyPN5xBtrf0MT9eOsBxzaHUlTQX1byBm0-QhHNQdInL9M3jiwAhvshc4sZuLAitiHd5Srhf-k_0qSjPLCmQiNaLBcK7LA49G7fXAWzRH4UbqBkCZhD8jXRxIHEYpmFZCvA Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:35:42.788480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec1c332dc5c44eee9c7c81787a435533", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec1c332dc5c44eee9c7c81787a435533"}]}] Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 85a24cb16a864a03920ccb359c13ec79 Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:35:42.790121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': 'cb8f74a7-256c-4810-944b-e4f66773aa13'} Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:35:42.791204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:35:42.793002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:35:42.794835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Returning 404 to user: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:35:42.794835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c3f31c6c-ecaf-4809-8a57-74c3a15cb057 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 404 len: 111 microversion: 2.20 time: 0.030046 Sep 09 21:35:42.794835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 417/855] 10.222.0.46 () {60 vars in 1280 bytes} [Fri Sep 9 21:35:42 2022] DELETE /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:35:42.798862 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:42.799480 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] [instance: cb8f74a7-256c-4810-944b-e4f66773aa13] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:42.805674 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:42.806163 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:42.806596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:42.807294 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:42.807778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:42.808209 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:42.822040 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] HTTP exception thrown: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Request method failure captured: Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 HTTP/1.1 Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG69DEBaOH-ADhfDFLp0KwqSisXNdgpiiCcdfB4pvSWzDezyPN5xBtrf0MT9eOsBxzaHUlTQX1byBm0-QhHNQdInL9M3jiwAhvshc4sZuLAitiHd5Srhf-k_0qSjPLCmQiNaLBcK7LA49G7fXAWzRH4UbqBkCZhD8jXRxIHEYpmFZCvA Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:35:42.823579 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec1c332dc5c44eee9c7c81787a435533", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec1c332dc5c44eee9c7c81787a435533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec1c332dc5c44eee9c7c81787a435533"}]}] Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: ec1c332dc5c44eee9c7c81787a435533 Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760404844 Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 85a24cb16a864a03920ccb359c13ec79 Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760404844-project Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:35:42.830240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': 'cb8f74a7-256c-4810-944b-e4f66773aa13'} Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:35:42.834719 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. Sep 09 21:35:42.838623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:35:42.840493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] Returning 404 to user: Instance cb8f74a7-256c-4810-944b-e4f66773aa13 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:35:42.840493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-fd32161f-df69-402d-910f-e87218c5a995 tempest-AttachVolumeShelveTestJSON-760404844 tempest-AttachVolumeShelveTestJSON-760404844-project] 10.222.0.46 "GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13" status: 404 len: 111 microversion: 2.20 time: 0.030698 Sep 09 21:35:42.840493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 439/856] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Sep 9 21:35:42 2022] GET /compute/v2.1/servers/cb8f74a7-256c-4810-944b-e4f66773aa13 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:35:51.575629 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-03285c3b-a319-45d6-9fe3-4eea6bec7348 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: .version_select at 0x7f0812dbaf70>, body: {"keypair": {"name": "tempest-keypair-1039286858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK32dAD8ht9T03sZeWcUlPPbDGXMbqe6q9n6mEHomf84VlAhNLurVRj1zA1IjjCQ4P1X3MWI23yytEaLpoGdV2tA6HQNUqGq9UDmgTh5liwwiRqVOyxG8skUoia2RRhA2A=="}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:35:51.594183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-03285c3b-a319-45d6-9fe3-4eea6bec7348 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for project 7cca63adb761474d82636997dade783a. Resources: {'key_pairs'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:35:51.602603 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-03285c3b-a319-45d6-9fe3-4eea6bec7348 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for user 70dcf397dc04470b9756119a9fe8f6a6 and project 7cca63adb761474d82636997dade783a. Resources: {'key_pairs'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:35:51.627512 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-03285c3b-a319-45d6-9fe3-4eea6bec7348 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176030 Sep 09 21:35:51.628152 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 418/857] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 21:35:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:35:53.205466 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1071121755", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8b93671-3117-4194-8e44-7e685c00fc4d"}], "security_groups": [{"name": "tempest-securitygroup--1705652010"}], "key_name": "tempest-keypair-1039286858", "user_data": "}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:35:53.214671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:53.215339 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:53.319615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.network.neutron [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] validate_networks() for [('b8b93671-3117-4194-8e44-7e685c00fc4d', None, None, None, None, None)] {{(pid=120465) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:35:53.703860 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Flavor limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:35:53.704347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Image limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:35:53.704828 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Flavor pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:35:53.705442 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Image pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:35:53.705858 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:35:53.715284 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:53.715897 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:53.716445 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:53.717251 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:53.717790 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:53.718293 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:53.737081 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for project 7cca63adb761474d82636997dade783a. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:35:53.741329 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for user 70dcf397dc04470b9756119a9fe8f6a6 and project 7cca63adb761474d82636997dade783a. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:35:53.753481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Going to run 1 instances... {{(pid=120465) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:35:53.755952 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:35:53.805222 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3b58f369-a046-4a09-a1cf-58a89219f27a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.604604 Sep 09 21:35:53.806035 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 440/858] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:35:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:35:53.817543 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-09e0046c-89d4-46a8-8a9e-15fd12dfc7bc tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:53.818162 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-09e0046c-89d4-46a8-8a9e-15fd12dfc7bc tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:53.820461 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=24 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:35:53.907993 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-09e0046c-89d4-46a8-8a9e-15fd12dfc7bc tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:53.918959 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-09e0046c-89d4-46a8-8a9e-15fd12dfc7bc tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1242 microversion: 2.1 time: 0.105870 Sep 09 21:35:53.931600 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 419/859] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:53 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:54.942892 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-64cd046a-d7f3-4996-a30d-217f8c70608f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:54.943519 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-64cd046a-d7f3-4996-a30d-217f8c70608f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:54.950634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-64cd046a-d7f3-4996-a30d-217f8c70608f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:54.951129 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-64cd046a-d7f3-4996-a30d-217f8c70608f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:54.951605 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-64cd046a-d7f3-4996-a30d-217f8c70608f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:54.952347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-64cd046a-d7f3-4996-a30d-217f8c70608f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:54.952819 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-64cd046a-d7f3-4996-a30d-217f8c70608f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:54.953247 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-64cd046a-d7f3-4996-a30d-217f8c70608f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:55.037107 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-64cd046a-d7f3-4996-a30d-217f8c70608f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:55.053863 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-64cd046a-d7f3-4996-a30d-217f8c70608f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1294 microversion: 2.1 time: 0.115320 Sep 09 21:35:55.055560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 441/860] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:54 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:56.076906 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6078b3cc-b435-4f48-b49e-6f87afd30e27 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:56.077674 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6078b3cc-b435-4f48-b49e-6f87afd30e27 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:56.084872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6078b3cc-b435-4f48-b49e-6f87afd30e27 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:56.085377 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6078b3cc-b435-4f48-b49e-6f87afd30e27 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:56.085823 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6078b3cc-b435-4f48-b49e-6f87afd30e27 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:56.086532 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6078b3cc-b435-4f48-b49e-6f87afd30e27 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:56.086990 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6078b3cc-b435-4f48-b49e-6f87afd30e27 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:56.087423 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6078b3cc-b435-4f48-b49e-6f87afd30e27 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:56.228769 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6078b3cc-b435-4f48-b49e-6f87afd30e27 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:56.236459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6078b3cc-b435-4f48-b49e-6f87afd30e27 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.163405 Sep 09 21:35:56.237019 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 420/861] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:56 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:56.809946 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-4485f6e5-794f-4a5c-8347-57acd3dcb068 req-0e2e7cde-2121-437a-880a-9867f771d6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac7aa13-bffc-474e-aef4-ee08d9428655", "tag": "a5e8e3e0-19dc-440b-865c-b3a30cd80dfe"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:35:56.820036 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-4485f6e5-794f-4a5c-8347-57acd3dcb068 req-0e2e7cde-2121-437a-880a-9867f771d6c7 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:56.820651 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-4485f6e5-794f-4a5c-8347-57acd3dcb068 req-0e2e7cde-2121-437a-880a-9867f771d6c7 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:56.821156 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-4485f6e5-794f-4a5c-8347-57acd3dcb068 req-0e2e7cde-2121-437a-880a-9867f771d6c7 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:56.833235 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-4485f6e5-794f-4a5c-8347-57acd3dcb068 req-0e2e7cde-2121-437a-880a-9867f771d6c7 service nova] Creating event network-changed:a5e8e3e0-19dc-440b-865c-b3a30cd80dfe for instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 on hv-cinder-85221 Sep 09 21:35:56.838031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-4485f6e5-794f-4a5c-8347-57acd3dcb068 req-0e2e7cde-2121-437a-880a-9867f771d6c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032285 Sep 09 21:35:56.838629 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 442/862] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:35:57.260526 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6a117da8-2032-4da7-b524-1b1afb178056 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:57.261288 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6a117da8-2032-4da7-b524-1b1afb178056 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:57.268286 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a117da8-2032-4da7-b524-1b1afb178056 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:57.268773 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a117da8-2032-4da7-b524-1b1afb178056 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:57.269253 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a117da8-2032-4da7-b524-1b1afb178056 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:57.269946 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a117da8-2032-4da7-b524-1b1afb178056 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:57.270403 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a117da8-2032-4da7-b524-1b1afb178056 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:57.270829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6a117da8-2032-4da7-b524-1b1afb178056 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:57.405321 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6a117da8-2032-4da7-b524-1b1afb178056 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:57.413303 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6a117da8-2032-4da7-b524-1b1afb178056 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.157441 Sep 09 21:35:57.413865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 421/863] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:57 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:58.437559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bd1ed4fb-99e9-4740-82ba-e1df2833934a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:58.438259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-bd1ed4fb-99e9-4740-82ba-e1df2833934a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:58.445359 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd1ed4fb-99e9-4740-82ba-e1df2833934a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:58.445848 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd1ed4fb-99e9-4740-82ba-e1df2833934a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:58.446290 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd1ed4fb-99e9-4740-82ba-e1df2833934a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:58.446980 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd1ed4fb-99e9-4740-82ba-e1df2833934a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:58.447440 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd1ed4fb-99e9-4740-82ba-e1df2833934a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:58.447899 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-bd1ed4fb-99e9-4740-82ba-e1df2833934a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:58.581189 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-bd1ed4fb-99e9-4740-82ba-e1df2833934a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:58.588919 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bd1ed4fb-99e9-4740-82ba-e1df2833934a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.156036 Sep 09 21:35:58.589482 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 443/864] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:58 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:35:59.611455 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-acc9c891-4a66-4ba1-a1f8-fc22422ac5c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:35:59.612141 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-acc9c891-4a66-4ba1-a1f8-fc22422ac5c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:35:59.618427 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-acc9c891-4a66-4ba1-a1f8-fc22422ac5c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:59.618909 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-acc9c891-4a66-4ba1-a1f8-fc22422ac5c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:59.619342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-acc9c891-4a66-4ba1-a1f8-fc22422ac5c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:59.620047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-acc9c891-4a66-4ba1-a1f8-fc22422ac5c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:35:59.620499 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-acc9c891-4a66-4ba1-a1f8-fc22422ac5c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:35:59.620918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-acc9c891-4a66-4ba1-a1f8-fc22422ac5c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:35:59.752469 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-acc9c891-4a66-4ba1-a1f8-fc22422ac5c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:35:59.760168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-acc9c891-4a66-4ba1-a1f8-fc22422ac5c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.152672 Sep 09 21:35:59.760720 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 422/865] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:35:59 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:00.782220 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9a8f850f-4289-40e3-b418-025a0f1d7068 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:00.782853 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9a8f850f-4289-40e3-b418-025a0f1d7068 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:00.790160 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a8f850f-4289-40e3-b418-025a0f1d7068 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:00.790646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a8f850f-4289-40e3-b418-025a0f1d7068 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:00.791080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a8f850f-4289-40e3-b418-025a0f1d7068 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:00.791793 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a8f850f-4289-40e3-b418-025a0f1d7068 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:00.792248 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a8f850f-4289-40e3-b418-025a0f1d7068 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:00.792676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a8f850f-4289-40e3-b418-025a0f1d7068 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:00.931660 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9a8f850f-4289-40e3-b418-025a0f1d7068 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:00.939230 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9a8f850f-4289-40e3-b418-025a0f1d7068 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.161103 Sep 09 21:36:00.939818 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 444/866] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:00 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:01.961061 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0b334803-3dc9-4c4e-bd59-94d384c152e7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:01.961665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0b334803-3dc9-4c4e-bd59-94d384c152e7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:01.968171 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b334803-3dc9-4c4e-bd59-94d384c152e7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:01.968654 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b334803-3dc9-4c4e-bd59-94d384c152e7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:01.969084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b334803-3dc9-4c4e-bd59-94d384c152e7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:01.969760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b334803-3dc9-4c4e-bd59-94d384c152e7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:01.970210 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b334803-3dc9-4c4e-bd59-94d384c152e7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:01.970625 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0b334803-3dc9-4c4e-bd59-94d384c152e7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:02.100451 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0b334803-3dc9-4c4e-bd59-94d384c152e7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:02.107964 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0b334803-3dc9-4c4e-bd59-94d384c152e7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.150726 Sep 09 21:36:02.108520 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 423/867] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:01 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:03.132312 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0b357643-706a-4f25-828b-616ef73b0bc8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:03.132925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0b357643-706a-4f25-828b-616ef73b0bc8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:03.139580 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b357643-706a-4f25-828b-616ef73b0bc8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:03.140081 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b357643-706a-4f25-828b-616ef73b0bc8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:03.140517 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b357643-706a-4f25-828b-616ef73b0bc8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:03.141221 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b357643-706a-4f25-828b-616ef73b0bc8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:03.141690 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b357643-706a-4f25-828b-616ef73b0bc8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:03.142121 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b357643-706a-4f25-828b-616ef73b0bc8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:03.315608 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0b357643-706a-4f25-828b-616ef73b0bc8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:03.323803 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0b357643-706a-4f25-828b-616ef73b0bc8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.196040 Sep 09 21:36:03.324382 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 445/868] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:03 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:04.346317 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4813d96e-916d-432b-ac94-94bf5b8f8d4f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:04.346927 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4813d96e-916d-432b-ac94-94bf5b8f8d4f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:04.349490 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:04.354799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4813d96e-916d-432b-ac94-94bf5b8f8d4f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:04.355324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4813d96e-916d-432b-ac94-94bf5b8f8d4f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:04.355740 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4813d96e-916d-432b-ac94-94bf5b8f8d4f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:04.356419 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4813d96e-916d-432b-ac94-94bf5b8f8d4f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:04.356866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4813d96e-916d-432b-ac94-94bf5b8f8d4f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:04.357298 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4813d96e-916d-432b-ac94-94bf5b8f8d4f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:04.494787 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4813d96e-916d-432b-ac94-94bf5b8f8d4f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:04.502602 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4813d96e-916d-432b-ac94-94bf5b8f8d4f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.160291 Sep 09 21:36:04.503107 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 424/869] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:04 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:05.526498 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-019953a1-7ddc-4ef1-b3a2-7316a9ea637a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:05.527116 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-019953a1-7ddc-4ef1-b3a2-7316a9ea637a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:05.529094 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:05.530229 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=6 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:05.537242 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-019953a1-7ddc-4ef1-b3a2-7316a9ea637a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:05.537737 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-019953a1-7ddc-4ef1-b3a2-7316a9ea637a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:05.538178 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-019953a1-7ddc-4ef1-b3a2-7316a9ea637a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:05.538913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-019953a1-7ddc-4ef1-b3a2-7316a9ea637a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:05.539352 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-019953a1-7ddc-4ef1-b3a2-7316a9ea637a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:05.539799 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-019953a1-7ddc-4ef1-b3a2-7316a9ea637a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:05.672431 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-019953a1-7ddc-4ef1-b3a2-7316a9ea637a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:05.680523 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-019953a1-7ddc-4ef1-b3a2-7316a9ea637a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.157985 Sep 09 21:36:05.681098 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 446/870] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:05 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:06.593853 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-8b6f30fa-4df0-4aad-882b-e41ac4b56e95 req-8185e2c9-9797-4264-ab2f-e0d633db1eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac7aa13-bffc-474e-aef4-ee08d9428655", "name": "network-vif-plugged", "status": "completed", "tag": "a5e8e3e0-19dc-440b-865c-b3a30cd80dfe"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:36:06.600906 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:06.608283 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-8b6f30fa-4df0-4aad-882b-e41ac4b56e95 req-8185e2c9-9797-4264-ab2f-e0d633db1eb2 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:06.608766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-8b6f30fa-4df0-4aad-882b-e41ac4b56e95 req-8185e2c9-9797-4264-ab2f-e0d633db1eb2 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:06.609113 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-8b6f30fa-4df0-4aad-882b-e41ac4b56e95 req-8185e2c9-9797-4264-ab2f-e0d633db1eb2 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:06.621766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-8b6f30fa-4df0-4aad-882b-e41ac4b56e95 req-8185e2c9-9797-4264-ab2f-e0d633db1eb2 service nova] Creating event network-vif-plugged:a5e8e3e0-19dc-440b-865c-b3a30cd80dfe for instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 on hv-cinder-85221 Sep 09 21:36:06.626864 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-8b6f30fa-4df0-4aad-882b-e41ac4b56e95 req-8185e2c9-9797-4264-ab2f-e0d633db1eb2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039174 Sep 09 21:36:06.628142 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 425/871] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:36:06.705059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2af87a13-7d91-47e7-8fa7-a7c9ff963791 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:06.705792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2af87a13-7d91-47e7-8fa7-a7c9ff963791 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:06.713453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2af87a13-7d91-47e7-8fa7-a7c9ff963791 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:06.713952 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2af87a13-7d91-47e7-8fa7-a7c9ff963791 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:06.715043 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2af87a13-7d91-47e7-8fa7-a7c9ff963791 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:06.715797 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2af87a13-7d91-47e7-8fa7-a7c9ff963791 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:06.716404 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2af87a13-7d91-47e7-8fa7-a7c9ff963791 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:06.716842 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2af87a13-7d91-47e7-8fa7-a7c9ff963791 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:06.905661 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2af87a13-7d91-47e7-8fa7-a7c9ff963791 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:06.913928 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2af87a13-7d91-47e7-8fa7-a7c9ff963791 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.214340 Sep 09 21:36:06.914498 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 447/872] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:06 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:07.940708 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-7a877faf-f892-4597-831c-4d10005e1f7a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:07.941436 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-7a877faf-f892-4597-831c-4d10005e1f7a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:07.948948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a877faf-f892-4597-831c-4d10005e1f7a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:07.949446 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a877faf-f892-4597-831c-4d10005e1f7a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:07.949892 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a877faf-f892-4597-831c-4d10005e1f7a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:07.950630 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a877faf-f892-4597-831c-4d10005e1f7a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:07.951093 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a877faf-f892-4597-831c-4d10005e1f7a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:07.951549 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7a877faf-f892-4597-831c-4d10005e1f7a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:08.085728 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7a877faf-f892-4597-831c-4d10005e1f7a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:08.093243 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-7a877faf-f892-4597-831c-4d10005e1f7a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1368 microversion: 2.1 time: 0.157192 Sep 09 21:36:08.093800 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 426/873] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:07 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:09.119559 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ba6928ad-214d-4cfe-878b-5960c5972516 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:09.120317 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ba6928ad-214d-4cfe-878b-5960c5972516 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:09.127304 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba6928ad-214d-4cfe-878b-5960c5972516 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:09.127830 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba6928ad-214d-4cfe-878b-5960c5972516 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:09.128277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba6928ad-214d-4cfe-878b-5960c5972516 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:09.130249 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba6928ad-214d-4cfe-878b-5960c5972516 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:09.130796 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba6928ad-214d-4cfe-878b-5960c5972516 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:09.131331 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ba6928ad-214d-4cfe-878b-5960c5972516 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:09.269950 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ba6928ad-214d-4cfe-878b-5960c5972516 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:09.278535 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ba6928ad-214d-4cfe-878b-5960c5972516 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1558 microversion: 2.1 time: 0.163028 Sep 09 21:36:09.279100 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 448/874] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:09 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:09.301883 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-f85258c7-4e8f-43e9-ad79-01ad51b10f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:09.302403 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-f85258c7-4e8f-43e9-ad79-01ad51b10f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:09.308764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f85258c7-4e8f-43e9-ad79-01ad51b10f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:09.309253 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f85258c7-4e8f-43e9-ad79-01ad51b10f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:09.309690 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f85258c7-4e8f-43e9-ad79-01ad51b10f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:09.310377 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f85258c7-4e8f-43e9-ad79-01ad51b10f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:09.310833 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f85258c7-4e8f-43e9-ad79-01ad51b10f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:09.311254 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-f85258c7-4e8f-43e9-ad79-01ad51b10f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:09.404669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-f85258c7-4e8f-43e9-ad79-01ad51b10f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106791 Sep 09 21:36:09.405669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 427/875] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 21:36:09 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:36:10.724449 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-33d9dfa3-8575-4a27-9ce8-10eefe15aec1 req-b923f2e5-1fdb-4a77-a5a4-91fd9ef5b750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac7aa13-bffc-474e-aef4-ee08d9428655", "tag": "a5e8e3e0-19dc-440b-865c-b3a30cd80dfe"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:36:10.735611 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-33d9dfa3-8575-4a27-9ce8-10eefe15aec1 req-b923f2e5-1fdb-4a77-a5a4-91fd9ef5b750 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:10.736425 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-33d9dfa3-8575-4a27-9ce8-10eefe15aec1 req-b923f2e5-1fdb-4a77-a5a4-91fd9ef5b750 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:10.737069 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-33d9dfa3-8575-4a27-9ce8-10eefe15aec1 req-b923f2e5-1fdb-4a77-a5a4-91fd9ef5b750 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:10.750354 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-33d9dfa3-8575-4a27-9ce8-10eefe15aec1 req-b923f2e5-1fdb-4a77-a5a4-91fd9ef5b750 service nova] Creating event network-changed:a5e8e3e0-19dc-440b-865c-b3a30cd80dfe for instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 on hv-cinder-85221 Sep 09 21:36:10.757111 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-33d9dfa3-8575-4a27-9ce8-10eefe15aec1 req-b923f2e5-1fdb-4a77-a5a4-91fd9ef5b750 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036315 Sep 09 21:36:10.761266 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 449/876] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:36:27.942810 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=5 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:27.943649 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=42 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:27.947871 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a483e3ca-36ec-4823-9763-2c0dc6418e4a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Action: 'create', calling method: .version_select at 0x7f0812dba5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-376666267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMcojOxzcKazsSoBsI9oQ5B1+Jz1cuGLQkUceIZUw4/vPQ3NWFB9903bYzXkuQo6rFJwaHyHLQQK+vxO04TIR7NRQxdY+H7oUdP7gFs75B9tJpKlOhjxT/mQ7dqSR+tJA=="}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:36:27.963545 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-a483e3ca-36ec-4823-9763-2c0dc6418e4a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Getting quotas for project 91a4df4888bc427ab3f8195e68604c96. Resources: {'key_pairs'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:36:27.967260 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-a483e3ca-36ec-4823-9763-2c0dc6418e4a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Getting quotas for user 4654c5c4e09e4c25ab58aca20cfcc7e2 and project 91a4df4888bc427ab3f8195e68604c96. Resources: {'key_pairs'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:36:27.989413 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a483e3ca-36ec-4823-9763-2c0dc6418e4a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048104 Sep 09 21:36:27.989988 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 428/877] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 21:36:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:36:28.039270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:28.040031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=48 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:28.044605 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-283075744", "imageRef": "4bffbcd4-b959-4015-94d4-1dd36d57ba71", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-376666267", "networks": [{"uuid": "c1614c40-5ecd-4829-8827-b189fe7df27e"}]}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:36:28.097262 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.network.neutron [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] validate_networks() for [('c1614c40-5ecd-4829-8827-b189fe7df27e', None, None, None, None, None)] {{(pid=120465) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:36:28.466068 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Flavor limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:36:28.466496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Image limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:36:28.466972 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Flavor pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:36:28.467396 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Image pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:36:28.467852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:36:28.476969 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:28.477455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:28.477898 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:28.478623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:28.479094 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:28.479506 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:28.496060 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Getting quotas for project 91a4df4888bc427ab3f8195e68604c96. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:36:28.499987 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Getting quotas for user 4654c5c4e09e4c25ab58aca20cfcc7e2 and project 91a4df4888bc427ab3f8195e68604c96. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:36:28.511665 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Going to run 1 instances... {{(pid=120465) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:36:28.513926 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4bffbcd4-b959-4015-94d4-1dd36d57ba71',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:36:28.559939 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9b848351-d8b9-4da4-a753-6089dd21a164 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522221 Sep 09 21:36:28.560581 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 450/878] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:36:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:36:28.572692 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0f494bf5-6e5a-4c3f-857d-abc51df85eb4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:28.573351 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0f494bf5-6e5a-4c3f-857d-abc51df85eb4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:28.631232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0f494bf5-6e5a-4c3f-857d-abc51df85eb4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:28.639752 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0f494bf5-6e5a-4c3f-857d-abc51df85eb4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1257 microversion: 2.1 time: 0.071043 Sep 09 21:36:28.640328 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 429/879] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:28 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:29.664991 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-fec68d55-8786-4992-95f4-77e7600ef08f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:29.665598 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-fec68d55-8786-4992-95f4-77e7600ef08f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:29.672553 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fec68d55-8786-4992-95f4-77e7600ef08f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:29.673036 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fec68d55-8786-4992-95f4-77e7600ef08f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:29.673469 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fec68d55-8786-4992-95f4-77e7600ef08f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:29.674145 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fec68d55-8786-4992-95f4-77e7600ef08f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:29.674599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fec68d55-8786-4992-95f4-77e7600ef08f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:29.675021 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fec68d55-8786-4992-95f4-77e7600ef08f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:29.740844 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-fec68d55-8786-4992-95f4-77e7600ef08f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:29.749526 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-fec68d55-8786-4992-95f4-77e7600ef08f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1309 microversion: 2.1 time: 0.089694 Sep 09 21:36:29.750087 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 451/880] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:29 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:30.773698 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-85770d45-fc8f-4574-9591-4a2a6be915ea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:30.774845 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-85770d45-fc8f-4574-9591-4a2a6be915ea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:30.784374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85770d45-fc8f-4574-9591-4a2a6be915ea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:30.785039 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85770d45-fc8f-4574-9591-4a2a6be915ea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:30.786496 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85770d45-fc8f-4574-9591-4a2a6be915ea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:30.787143 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85770d45-fc8f-4574-9591-4a2a6be915ea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:30.787948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85770d45-fc8f-4574-9591-4a2a6be915ea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:30.788458 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-85770d45-fc8f-4574-9591-4a2a6be915ea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:30.930704 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-85770d45-fc8f-4574-9591-4a2a6be915ea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:30.938400 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-85770d45-fc8f-4574-9591-4a2a6be915ea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.170242 Sep 09 21:36:30.939272 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 430/881] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:30 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:31.962278 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9a2708b3-0fa8-4396-9a9b-2609c726a50d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:31.963124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9a2708b3-0fa8-4396-9a9b-2609c726a50d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:31.969642 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a2708b3-0fa8-4396-9a9b-2609c726a50d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:31.970121 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a2708b3-0fa8-4396-9a9b-2609c726a50d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:31.970553 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a2708b3-0fa8-4396-9a9b-2609c726a50d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:31.971234 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a2708b3-0fa8-4396-9a9b-2609c726a50d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:31.971718 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a2708b3-0fa8-4396-9a9b-2609c726a50d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:31.972144 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9a2708b3-0fa8-4396-9a9b-2609c726a50d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:32.113297 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9a2708b3-0fa8-4396-9a9b-2609c726a50d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:32.121750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9a2708b3-0fa8-4396-9a9b-2609c726a50d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.163954 Sep 09 21:36:32.122302 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 452/882] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:31 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:33.146613 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8c061d79-2911-48ae-9b96-dc0f720d1349 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:33.147231 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8c061d79-2911-48ae-9b96-dc0f720d1349 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:33.153896 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c061d79-2911-48ae-9b96-dc0f720d1349 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:33.154384 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c061d79-2911-48ae-9b96-dc0f720d1349 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:33.154817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c061d79-2911-48ae-9b96-dc0f720d1349 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:33.155510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c061d79-2911-48ae-9b96-dc0f720d1349 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:33.156189 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c061d79-2911-48ae-9b96-dc0f720d1349 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:33.156878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8c061d79-2911-48ae-9b96-dc0f720d1349 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:33.297356 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-8c061d79-2911-48ae-9b96-dc0f720d1349 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:33.306522 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8c061d79-2911-48ae-9b96-dc0f720d1349 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.163910 Sep 09 21:36:33.307494 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 431/883] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:33 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:36:34.330440 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8e47f82b-b080-4245-a6f4-ea9941dad898 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:34.331113 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8e47f82b-b080-4245-a6f4-ea9941dad898 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:34.338470 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8e47f82b-b080-4245-a6f4-ea9941dad898 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:34.338971 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8e47f82b-b080-4245-a6f4-ea9941dad898 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:34.339407 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8e47f82b-b080-4245-a6f4-ea9941dad898 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:34.340202 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8e47f82b-b080-4245-a6f4-ea9941dad898 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:34.340662 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8e47f82b-b080-4245-a6f4-ea9941dad898 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:34.341089 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8e47f82b-b080-4245-a6f4-ea9941dad898 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:34.480551 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8e47f82b-b080-4245-a6f4-ea9941dad898 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:34.488746 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8e47f82b-b080-4245-a6f4-ea9941dad898 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.162293 Sep 09 21:36:34.490150 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 453/884] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:34 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:36:35.512949 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-fd9470cc-9d6c-4602-aadc-98e0f2cae58a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:35.513621 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-fd9470cc-9d6c-4602-aadc-98e0f2cae58a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:35.520646 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fd9470cc-9d6c-4602-aadc-98e0f2cae58a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:35.521222 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fd9470cc-9d6c-4602-aadc-98e0f2cae58a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:35.521713 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fd9470cc-9d6c-4602-aadc-98e0f2cae58a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:35.522328 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fd9470cc-9d6c-4602-aadc-98e0f2cae58a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:35.522781 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fd9470cc-9d6c-4602-aadc-98e0f2cae58a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:35.523200 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fd9470cc-9d6c-4602-aadc-98e0f2cae58a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:35.672662 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-fd9470cc-9d6c-4602-aadc-98e0f2cae58a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:35.680981 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-fd9470cc-9d6c-4602-aadc-98e0f2cae58a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.171757 Sep 09 21:36:35.688072 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 432/885] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:35 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:36.704974 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3c9074e7-d274-43e4-8cb9-f58e0fab066b tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:36.706350 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3c9074e7-d274-43e4-8cb9-f58e0fab066b tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:36.713522 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c9074e7-d274-43e4-8cb9-f58e0fab066b tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:36.713983 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c9074e7-d274-43e4-8cb9-f58e0fab066b tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:36.714888 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c9074e7-d274-43e4-8cb9-f58e0fab066b tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:36.715132 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c9074e7-d274-43e4-8cb9-f58e0fab066b tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:36.715614 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c9074e7-d274-43e4-8cb9-f58e0fab066b tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:36.716050 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3c9074e7-d274-43e4-8cb9-f58e0fab066b tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:36.852662 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-3c9074e7-d274-43e4-8cb9-f58e0fab066b tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:36.861590 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3c9074e7-d274-43e4-8cb9-f58e0fab066b tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.161052 Sep 09 21:36:36.862167 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 454/886] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:36 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:37.885722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-90322137-4228-4668-9af0-f3d02b800236 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:37.886371 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-90322137-4228-4668-9af0-f3d02b800236 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:37.893001 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90322137-4228-4668-9af0-f3d02b800236 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:37.893427 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90322137-4228-4668-9af0-f3d02b800236 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:37.893867 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90322137-4228-4668-9af0-f3d02b800236 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:37.894569 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90322137-4228-4668-9af0-f3d02b800236 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:37.895044 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90322137-4228-4668-9af0-f3d02b800236 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:37.895479 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-90322137-4228-4668-9af0-f3d02b800236 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:38.033760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-90322137-4228-4668-9af0-f3d02b800236 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:38.043493 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-90322137-4228-4668-9af0-f3d02b800236 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.161633 Sep 09 21:36:38.044097 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 433/887] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:37 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:39.067291 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-00f60f32-f2ee-4a1d-92cb-0ad249c7512f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:39.068171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-00f60f32-f2ee-4a1d-92cb-0ad249c7512f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:39.072053 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:39.072763 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=6 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:39.077436 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-00f60f32-f2ee-4a1d-92cb-0ad249c7512f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:39.077933 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-00f60f32-f2ee-4a1d-92cb-0ad249c7512f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:39.078368 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-00f60f32-f2ee-4a1d-92cb-0ad249c7512f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:39.079267 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-00f60f32-f2ee-4a1d-92cb-0ad249c7512f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:39.079751 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-00f60f32-f2ee-4a1d-92cb-0ad249c7512f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:39.080171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-00f60f32-f2ee-4a1d-92cb-0ad249c7512f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:39.216508 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-00f60f32-f2ee-4a1d-92cb-0ad249c7512f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:39.225174 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-00f60f32-f2ee-4a1d-92cb-0ad249c7512f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.161538 Sep 09 21:36:39.225745 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 455/888] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:39 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:40.247905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ea0b096a-53c6-4509-99d6-15432096bebc tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:40.248526 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ea0b096a-53c6-4509-99d6-15432096bebc tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:40.250394 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:36:40.256880 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea0b096a-53c6-4509-99d6-15432096bebc tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:40.257376 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea0b096a-53c6-4509-99d6-15432096bebc tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:40.257817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea0b096a-53c6-4509-99d6-15432096bebc tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:40.258511 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea0b096a-53c6-4509-99d6-15432096bebc tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:40.258975 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea0b096a-53c6-4509-99d6-15432096bebc tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:40.259400 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea0b096a-53c6-4509-99d6-15432096bebc tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:40.400021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ea0b096a-53c6-4509-99d6-15432096bebc tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:40.407877 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ea0b096a-53c6-4509-99d6-15432096bebc tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.163728 Sep 09 21:36:40.408436 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 434/889] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:40 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:41.432317 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-32c27f82-0064-4115-bdf2-a9fe92b66f74 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:41.432967 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-32c27f82-0064-4115-bdf2-a9fe92b66f74 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:41.439280 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-32c27f82-0064-4115-bdf2-a9fe92b66f74 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:41.439788 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-32c27f82-0064-4115-bdf2-a9fe92b66f74 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:41.440223 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-32c27f82-0064-4115-bdf2-a9fe92b66f74 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:41.440904 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-32c27f82-0064-4115-bdf2-a9fe92b66f74 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:41.441356 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-32c27f82-0064-4115-bdf2-a9fe92b66f74 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:41.441782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-32c27f82-0064-4115-bdf2-a9fe92b66f74 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:41.575575 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-32c27f82-0064-4115-bdf2-a9fe92b66f74 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:41.584290 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-32c27f82-0064-4115-bdf2-a9fe92b66f74 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.156456 Sep 09 21:36:41.584856 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 456/890] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:41 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:42.608177 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-36e53585-0638-4428-b5c2-27d4b18ca438 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:42.608789 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-36e53585-0638-4428-b5c2-27d4b18ca438 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:42.615908 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-36e53585-0638-4428-b5c2-27d4b18ca438 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:42.616390 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-36e53585-0638-4428-b5c2-27d4b18ca438 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:42.616826 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-36e53585-0638-4428-b5c2-27d4b18ca438 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:42.617507 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-36e53585-0638-4428-b5c2-27d4b18ca438 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:42.617965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-36e53585-0638-4428-b5c2-27d4b18ca438 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:42.618394 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-36e53585-0638-4428-b5c2-27d4b18ca438 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:42.751071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-36e53585-0638-4428-b5c2-27d4b18ca438 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:42.758846 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-36e53585-0638-4428-b5c2-27d4b18ca438 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.154516 Sep 09 21:36:42.759409 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 435/891] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:42 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:43.781553 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a85a8241-528d-48a6-b17d-e13b515b8a6d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:43.782447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a85a8241-528d-48a6-b17d-e13b515b8a6d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:43.788565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a85a8241-528d-48a6-b17d-e13b515b8a6d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:43.789064 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a85a8241-528d-48a6-b17d-e13b515b8a6d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:43.789504 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a85a8241-528d-48a6-b17d-e13b515b8a6d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:43.790204 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a85a8241-528d-48a6-b17d-e13b515b8a6d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:43.790669 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a85a8241-528d-48a6-b17d-e13b515b8a6d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:43.791102 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a85a8241-528d-48a6-b17d-e13b515b8a6d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:43.975305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a85a8241-528d-48a6-b17d-e13b515b8a6d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:43.983019 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a85a8241-528d-48a6-b17d-e13b515b8a6d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.205588 Sep 09 21:36:43.983617 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 457/892] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:43 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:44.009215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-3a591d2a-bde7-4295-91da-d4ca269661eb req-e4fb111b-bf0f-4e4a-8cd5-2800c14a8052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83882853-8b42-46e9-9059-823457adff9a", "tag": "3e813f66-d068-4e01-bb0e-c9e89d846726"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:36:44.021192 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-3a591d2a-bde7-4295-91da-d4ca269661eb req-e4fb111b-bf0f-4e4a-8cd5-2800c14a8052 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:44.021765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-3a591d2a-bde7-4295-91da-d4ca269661eb req-e4fb111b-bf0f-4e4a-8cd5-2800c14a8052 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:44.022204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-3a591d2a-bde7-4295-91da-d4ca269661eb req-e4fb111b-bf0f-4e4a-8cd5-2800c14a8052 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:44.033631 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-3a591d2a-bde7-4295-91da-d4ca269661eb req-e4fb111b-bf0f-4e4a-8cd5-2800c14a8052 service nova] Creating event network-changed:3e813f66-d068-4e01-bb0e-c9e89d846726 for instance 83882853-8b42-46e9-9059-823457adff9a on hv-cinder-85221 Sep 09 21:36:44.040012 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-3a591d2a-bde7-4295-91da-d4ca269661eb req-e4fb111b-bf0f-4e4a-8cd5-2800c14a8052 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034980 Sep 09 21:36:44.040660 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 436/893] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:36:45.009481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-90702c7e-0204-41e4-a544-6ab8c4a6668a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:45.010470 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-90702c7e-0204-41e4-a544-6ab8c4a6668a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:45.017172 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-90702c7e-0204-41e4-a544-6ab8c4a6668a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:45.017670 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-90702c7e-0204-41e4-a544-6ab8c4a6668a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:45.018116 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-90702c7e-0204-41e4-a544-6ab8c4a6668a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:45.018820 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-90702c7e-0204-41e4-a544-6ab8c4a6668a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:45.019282 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-90702c7e-0204-41e4-a544-6ab8c4a6668a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:45.019747 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-90702c7e-0204-41e4-a544-6ab8c4a6668a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:45.182721 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-90702c7e-0204-41e4-a544-6ab8c4a6668a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:45.192824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-90702c7e-0204-41e4-a544-6ab8c4a6668a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.189173 Sep 09 21:36:45.193586 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 458/894] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:45 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:46.223175 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ea566eac-a390-409b-9829-12a0d8eae122 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:46.224570 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ea566eac-a390-409b-9829-12a0d8eae122 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:46.230508 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea566eac-a390-409b-9829-12a0d8eae122 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:46.230983 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea566eac-a390-409b-9829-12a0d8eae122 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:46.231419 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea566eac-a390-409b-9829-12a0d8eae122 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:46.232122 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea566eac-a390-409b-9829-12a0d8eae122 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:46.232588 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea566eac-a390-409b-9829-12a0d8eae122 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:46.232993 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ea566eac-a390-409b-9829-12a0d8eae122 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:46.359978 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ea566eac-a390-409b-9829-12a0d8eae122 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:46.367766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ea566eac-a390-409b-9829-12a0d8eae122 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.149250 Sep 09 21:36:46.368324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 437/895] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:46 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:47.391395 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-95e8cd3c-70ce-41e0-9632-ac083e6128d1 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:47.392006 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-95e8cd3c-70ce-41e0-9632-ac083e6128d1 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:47.398692 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95e8cd3c-70ce-41e0-9632-ac083e6128d1 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:47.399171 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95e8cd3c-70ce-41e0-9632-ac083e6128d1 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:47.399637 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95e8cd3c-70ce-41e0-9632-ac083e6128d1 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:47.400325 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95e8cd3c-70ce-41e0-9632-ac083e6128d1 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:47.400781 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95e8cd3c-70ce-41e0-9632-ac083e6128d1 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:47.401208 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-95e8cd3c-70ce-41e0-9632-ac083e6128d1 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:47.528196 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-95e8cd3c-70ce-41e0-9632-ac083e6128d1 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:47.536767 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-95e8cd3c-70ce-41e0-9632-ac083e6128d1 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.148829 Sep 09 21:36:47.537418 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 459/896] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:47 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:48.560307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-32447308-874b-4d85-9f57-3930995336ee tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:48.560926 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-32447308-874b-4d85-9f57-3930995336ee tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:48.567562 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32447308-874b-4d85-9f57-3930995336ee tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:48.568056 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32447308-874b-4d85-9f57-3930995336ee tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:48.568492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32447308-874b-4d85-9f57-3930995336ee tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:48.569178 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32447308-874b-4d85-9f57-3930995336ee tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:48.569634 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32447308-874b-4d85-9f57-3930995336ee tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:48.570058 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32447308-874b-4d85-9f57-3930995336ee tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:48.712663 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-32447308-874b-4d85-9f57-3930995336ee tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:48.720524 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-32447308-874b-4d85-9f57-3930995336ee tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.164001 Sep 09 21:36:48.721091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 438/897] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:48 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:48.796114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-f66480df-1d6e-45f0-b383-21d87168c9cd req-b8aad244-db82-40bd-a24f-c6bbebb2610f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83882853-8b42-46e9-9059-823457adff9a", "name": "network-vif-plugged", "status": "completed", "tag": "3e813f66-d068-4e01-bb0e-c9e89d846726"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:36:48.807147 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-f66480df-1d6e-45f0-b383-21d87168c9cd req-b8aad244-db82-40bd-a24f-c6bbebb2610f service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:48.807790 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-f66480df-1d6e-45f0-b383-21d87168c9cd req-b8aad244-db82-40bd-a24f-c6bbebb2610f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:48.808237 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-f66480df-1d6e-45f0-b383-21d87168c9cd req-b8aad244-db82-40bd-a24f-c6bbebb2610f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:48.819355 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-f66480df-1d6e-45f0-b383-21d87168c9cd req-b8aad244-db82-40bd-a24f-c6bbebb2610f service nova] Creating event network-vif-plugged:3e813f66-d068-4e01-bb0e-c9e89d846726 for instance 83882853-8b42-46e9-9059-823457adff9a on hv-cinder-85221 Sep 09 21:36:48.824438 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-f66480df-1d6e-45f0-b383-21d87168c9cd req-b8aad244-db82-40bd-a24f-c6bbebb2610f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031997 Sep 09 21:36:48.825023 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 460/898] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:36:49.744467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-df311559-b560-488c-a8ec-23efaf76e671 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:49.745074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-df311559-b560-488c-a8ec-23efaf76e671 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:49.750923 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df311559-b560-488c-a8ec-23efaf76e671 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:49.751405 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df311559-b560-488c-a8ec-23efaf76e671 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:49.751878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df311559-b560-488c-a8ec-23efaf76e671 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:49.752556 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df311559-b560-488c-a8ec-23efaf76e671 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:49.753009 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df311559-b560-488c-a8ec-23efaf76e671 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:49.753437 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df311559-b560-488c-a8ec-23efaf76e671 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:49.881563 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-df311559-b560-488c-a8ec-23efaf76e671 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:49.889243 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-df311559-b560-488c-a8ec-23efaf76e671 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1357 microversion: 2.1 time: 0.148815 Sep 09 21:36:49.889729 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 439/899] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:49 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:50.914061 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-22e0bb87-c9f3-4872-9c59-a12b52b545aa tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:50.914772 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-22e0bb87-c9f3-4872-9c59-a12b52b545aa tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:50.921016 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22e0bb87-c9f3-4872-9c59-a12b52b545aa tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:50.921502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22e0bb87-c9f3-4872-9c59-a12b52b545aa tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:50.921946 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22e0bb87-c9f3-4872-9c59-a12b52b545aa tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:50.922634 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22e0bb87-c9f3-4872-9c59-a12b52b545aa tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:50.923094 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22e0bb87-c9f3-4872-9c59-a12b52b545aa tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:50.923519 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-22e0bb87-c9f3-4872-9c59-a12b52b545aa tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:51.053981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-22e0bb87-c9f3-4872-9c59-a12b52b545aa tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:51.061608 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-22e0bb87-c9f3-4872-9c59-a12b52b545aa tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1546 microversion: 2.1 time: 0.152920 Sep 09 21:36:51.062159 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 461/900] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:50 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:51.085226 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5c563e45-eb7e-4f24-8801-d985eba5dbaf tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:51.085851 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5c563e45-eb7e-4f24-8801-d985eba5dbaf tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:51.092411 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c563e45-eb7e-4f24-8801-d985eba5dbaf tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:51.092900 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c563e45-eb7e-4f24-8801-d985eba5dbaf tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:51.093447 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c563e45-eb7e-4f24-8801-d985eba5dbaf tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:51.094146 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c563e45-eb7e-4f24-8801-d985eba5dbaf tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:51.094606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c563e45-eb7e-4f24-8801-d985eba5dbaf tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:51.095036 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5c563e45-eb7e-4f24-8801-d985eba5dbaf tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:51.226190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5c563e45-eb7e-4f24-8801-d985eba5dbaf tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:51.233735 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5c563e45-eb7e-4f24-8801-d985eba5dbaf tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1546 microversion: 2.1 time: 0.152999 Sep 09 21:36:51.234284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 440/901] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:51 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:51.256577 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:51.261398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:51.262165 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Searching by: {'deleted': False, 'project_id': '91a4df4888bc427ab3f8195e68604c96'} {{(pid=120465) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 21:36:51.268884 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:51.269362 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:51.269792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:51.270516 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:51.270957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:51.271377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:51.358313 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.multi_cell_list [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120465) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 21:36:51.454009 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a0c39fff-41da-4501-a983-291cfcee7675 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201852 Sep 09 21:36:51.454481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 462/902] 10.222.0.46 () {58 vars in 1125 bytes} [Fri Sep 9 21:36:51 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:36:51.466242 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5fd835fc-f9ee-42dd-8d1d-9c00d840640e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:36:51.466861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5fd835fc-f9ee-42dd-8d1d-9c00d840640e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:51.472806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fd835fc-f9ee-42dd-8d1d-9c00d840640e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:51.473294 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fd835fc-f9ee-42dd-8d1d-9c00d840640e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:51.473765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fd835fc-f9ee-42dd-8d1d-9c00d840640e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:51.474470 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fd835fc-f9ee-42dd-8d1d-9c00d840640e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:51.474930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fd835fc-f9ee-42dd-8d1d-9c00d840640e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:51.475360 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fd835fc-f9ee-42dd-8d1d-9c00d840640e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:51.604169 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5fd835fc-f9ee-42dd-8d1d-9c00d840640e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:36:51.611816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5fd835fc-f9ee-42dd-8d1d-9c00d840640e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1546 microversion: 2.1 time: 0.149339 Sep 09 21:36:51.612380 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 441/903] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:36:51 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:36:53.148633 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e5134b67-636f-4851-8136-f07e9bb98b2a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1672187d-2650-443e-af75-1d600e713728"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:36:53.150983 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e5134b67-636f-4851-8136-f07e9bb98b2a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:36:53.157396 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5134b67-636f-4851-8136-f07e9bb98b2a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:53.158134 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5134b67-636f-4851-8136-f07e9bb98b2a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:53.158564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5134b67-636f-4851-8136-f07e9bb98b2a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:53.159239 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5134b67-636f-4851-8136-f07e9bb98b2a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:36:53.159724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5134b67-636f-4851-8136-f07e9bb98b2a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:36:53.160147 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e5134b67-636f-4851-8136-f07e9bb98b2a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:36:53.417281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e5134b67-636f-4851-8136-f07e9bb98b2a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "POST /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272420 Sep 09 21:36:53.417876 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 463/904] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:36:53 2022] POST /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:37:01.011213 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a7303692-23bf-4b6c-8dab-849950341e79 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:01.011853 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a7303692-23bf-4b6c-8dab-849950341e79 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:01.014344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:01.019380 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7303692-23bf-4b6c-8dab-849950341e79 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:01.019897 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7303692-23bf-4b6c-8dab-849950341e79 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:01.020331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7303692-23bf-4b6c-8dab-849950341e79 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:01.021010 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7303692-23bf-4b6c-8dab-849950341e79 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:01.021458 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7303692-23bf-4b6c-8dab-849950341e79 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:01.021878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a7303692-23bf-4b6c-8dab-849950341e79 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:01.025409 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=69 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:01.156594 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a7303692-23bf-4b6c-8dab-849950341e79 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:01.165325 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a7303692-23bf-4b6c-8dab-849950341e79 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1592 microversion: 2.1 time: 0.158473 Sep 09 21:37:01.165902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 442/905] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:01 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1592 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:02.837649 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:02.978412 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-ee17c3e9-ae1f-493a-9edb-97394c30c26c req-8d19c9ed-2cc5-4189-848e-d7c28875534e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83882853-8b42-46e9-9059-823457adff9a", "tag": "3e813f66-d068-4e01-bb0e-c9e89d846726"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:37:02.998188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:03.002269 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-ee17c3e9-ae1f-493a-9edb-97394c30c26c req-8d19c9ed-2cc5-4189-848e-d7c28875534e service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:03.002974 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-ee17c3e9-ae1f-493a-9edb-97394c30c26c req-8d19c9ed-2cc5-4189-848e-d7c28875534e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:03.003418 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-ee17c3e9-ae1f-493a-9edb-97394c30c26c req-8d19c9ed-2cc5-4189-848e-d7c28875534e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:03.007859 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:03.022084 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-ee17c3e9-ae1f-493a-9edb-97394c30c26c req-8d19c9ed-2cc5-4189-848e-d7c28875534e service nova] Creating event network-changed:3e813f66-d068-4e01-bb0e-c9e89d846726 for instance 83882853-8b42-46e9-9059-823457adff9a on hv-cinder-85221 Sep 09 21:37:03.029324 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-ee17c3e9-ae1f-493a-9edb-97394c30c26c req-8d19c9ed-2cc5-4189-848e-d7c28875534e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192921 Sep 09 21:37:03.030240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 464/906] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:37:03.850899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e6ea4b37-899b-4989-8dfa-c338625d112a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1789702605"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:37:03.851634 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e6ea4b37-899b-4989-8dfa-c338625d112a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:03.858179 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6ea4b37-899b-4989-8dfa-c338625d112a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:03.858674 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6ea4b37-899b-4989-8dfa-c338625d112a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:03.859116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6ea4b37-899b-4989-8dfa-c338625d112a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:03.859849 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6ea4b37-899b-4989-8dfa-c338625d112a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:03.860307 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6ea4b37-899b-4989-8dfa-c338625d112a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:03.860737 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6ea4b37-899b-4989-8dfa-c338625d112a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:03.996323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.network.security_group_api [None req-e6ea4b37-899b-4989-8dfa-c338625d112a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Adding security group acc53eaa-9c25-4411-bdb7-1831f8763d1b to port 3e813f66-d068-4e01-bb0e-c9e89d846726 Sep 09 21:37:04.318336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e6ea4b37-899b-4989-8dfa-c338625d112a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "POST /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/action" status: 202 len: 0 microversion: 2.1 time: 0.471598 Sep 09 21:37:04.321807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 443/907] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:37:03 2022] POST /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:37:04.328357 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-29e21a69-08a9-473a-b06a-e14ffdcec7c5 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:04.329005 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-29e21a69-08a9-473a-b06a-e14ffdcec7c5 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:04.336293 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-29e21a69-08a9-473a-b06a-e14ffdcec7c5 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:04.336787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-29e21a69-08a9-473a-b06a-e14ffdcec7c5 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:04.337236 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-29e21a69-08a9-473a-b06a-e14ffdcec7c5 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:04.337929 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-29e21a69-08a9-473a-b06a-e14ffdcec7c5 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:04.338392 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-29e21a69-08a9-473a-b06a-e14ffdcec7c5 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:04.338838 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-29e21a69-08a9-473a-b06a-e14ffdcec7c5 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:04.492861 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-29e21a69-08a9-473a-b06a-e14ffdcec7c5 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:04.501000 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-29e21a69-08a9-473a-b06a-e14ffdcec7c5 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1758 microversion: 2.1 time: 0.177613 Sep 09 21:37:04.501568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 465/908] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:04 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:05.048424 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-cd94f69b-9b26-493b-a0c9-b5395fc1d253 req-0cd61b0b-0d63-4058-8c73-fae0d09f9064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83882853-8b42-46e9-9059-823457adff9a", "tag": "3e813f66-d068-4e01-bb0e-c9e89d846726"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:37:05.058292 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-cd94f69b-9b26-493b-a0c9-b5395fc1d253 req-0cd61b0b-0d63-4058-8c73-fae0d09f9064 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:05.058770 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-cd94f69b-9b26-493b-a0c9-b5395fc1d253 req-0cd61b0b-0d63-4058-8c73-fae0d09f9064 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:05.059203 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-cd94f69b-9b26-493b-a0c9-b5395fc1d253 req-0cd61b0b-0d63-4058-8c73-fae0d09f9064 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:05.076226 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-cd94f69b-9b26-493b-a0c9-b5395fc1d253 req-0cd61b0b-0d63-4058-8c73-fae0d09f9064 service nova] Creating event network-changed:3e813f66-d068-4e01-bb0e-c9e89d846726 for instance 83882853-8b42-46e9-9059-823457adff9a on hv-cinder-85221 Sep 09 21:37:05.082376 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-cd94f69b-9b26-493b-a0c9-b5395fc1d253 req-0cd61b0b-0d63-4058-8c73-fae0d09f9064 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038252 Sep 09 21:37:05.082960 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 444/909] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:37:26.387933 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f60c92fe-3a00-49a9-b03b-3b13f197ade2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:26.388542 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f60c92fe-3a00-49a9-b03b-3b13f197ade2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:26.390938 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=3 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:26.391596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=7 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:26.399375 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f60c92fe-3a00-49a9-b03b-3b13f197ade2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:26.399892 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f60c92fe-3a00-49a9-b03b-3b13f197ade2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:26.400330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f60c92fe-3a00-49a9-b03b-3b13f197ade2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:26.401054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f60c92fe-3a00-49a9-b03b-3b13f197ade2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:26.402017 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f60c92fe-3a00-49a9-b03b-3b13f197ade2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:26.402440 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f60c92fe-3a00-49a9-b03b-3b13f197ade2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:26.426088 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f60c92fe-3a00-49a9-b03b-3b13f197ade2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/ips" status: 200 len: 150 microversion: 2.1 time: 0.042348 Sep 09 21:37:26.426648 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 466/910] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:37:26 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:37:27.793733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=5 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:27.794484 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=11 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:27.799303 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5228d261-00e1-450f-86ef-5c65ea023f5a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ace41d65-6cc7-48af-ba58-a7432fcc2ddc"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:37:27.801697 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5228d261-00e1-450f-86ef-5c65ea023f5a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:27.809794 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5228d261-00e1-450f-86ef-5c65ea023f5a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:27.810286 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5228d261-00e1-450f-86ef-5c65ea023f5a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:27.810729 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5228d261-00e1-450f-86ef-5c65ea023f5a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:27.811422 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5228d261-00e1-450f-86ef-5c65ea023f5a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:27.811980 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5228d261-00e1-450f-86ef-5c65ea023f5a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:27.812415 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5228d261-00e1-450f-86ef-5c65ea023f5a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:28.073820 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5228d261-00e1-450f-86ef-5c65ea023f5a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282103 Sep 09 21:37:28.074418 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 445/911] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:37:27 2022] POST /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:37:35.614598 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5a97fc89-d229-4e4a-8de8-6f9950cd4219 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: .version_select at 0x7f0813be1ca0>, body: {"keypair": {"name": "tempest-keypair-2054577772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt9i2pqQWCyAvNW9JSpUiWtY6Y8eWyRRy2pL0ZEOBQmqZWeYF9y9S7bQdx0E3Yu5cyXO1XIvTry3pecS248dSpyNHgQoUS2tq0jQOJsSiAMhQDMTy56QZf/8X4s1VrFpg=="}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:37:35.630986 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-5a97fc89-d229-4e4a-8de8-6f9950cd4219 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for project 7cca63adb761474d82636997dade783a. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:37:35.634873 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-5a97fc89-d229-4e4a-8de8-6f9950cd4219 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for user 70dcf397dc04470b9756119a9fe8f6a6 and project 7cca63adb761474d82636997dade783a. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:37:35.659079 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5a97fc89-d229-4e4a-8de8-6f9950cd4219 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048290 Sep 09 21:37:35.659936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 467/912] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 21:37:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:37:36.921590 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-482894837", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8b93671-3117-4194-8e44-7e685c00fc4d"}], "security_groups": [{"name": "tempest-securitygroup--1617412791"}], "key_name": "tempest-keypair-2054577772", "user_data": "}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:37:37.024264 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] validate_networks() for [('b8b93671-3117-4194-8e44-7e685c00fc4d', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:37:37.455246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:37:37.455645 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:37:37.456120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:37:37.456530 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:37:37.456941 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:37:37.466296 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:37.466785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:37.467224 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:37.467985 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:37.468442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:37.468873 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:37.485153 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for project 7cca63adb761474d82636997dade783a. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:37:37.489116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for user 70dcf397dc04470b9756119a9fe8f6a6 and project 7cca63adb761474d82636997dade783a. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:37:37.499922 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:37:37.502248 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:37:37.550386 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-bebb8241-6250-4815-864e-a6785f4a4f99 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.634880 Sep 09 21:37:37.551221 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 446/913] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:37:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:37:37.559585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=4 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:37.565135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1ae909ee-ef1f-42b3-9b82-f6b4ee89545a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:37.565832 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1ae909ee-ef1f-42b3-9b82-f6b4ee89545a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:37.630475 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1ae909ee-ef1f-42b3-9b82-f6b4ee89545a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:37.639156 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1ae909ee-ef1f-42b3-9b82-f6b4ee89545a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1241 microversion: 2.1 time: 0.080582 Sep 09 21:37:37.640054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 468/914] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:37 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:38.661774 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-12afc7db-e845-4291-9f3e-067c8d6c3e87 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:38.662419 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-12afc7db-e845-4291-9f3e-067c8d6c3e87 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:38.670138 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12afc7db-e845-4291-9f3e-067c8d6c3e87 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:38.670614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12afc7db-e845-4291-9f3e-067c8d6c3e87 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:38.671049 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12afc7db-e845-4291-9f3e-067c8d6c3e87 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:38.671783 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12afc7db-e845-4291-9f3e-067c8d6c3e87 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:38.672246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12afc7db-e845-4291-9f3e-067c8d6c3e87 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:38.672671 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-12afc7db-e845-4291-9f3e-067c8d6c3e87 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:38.735491 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-12afc7db-e845-4291-9f3e-067c8d6c3e87 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:38.743512 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-12afc7db-e845-4291-9f3e-067c8d6c3e87 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1301 microversion: 2.1 time: 0.086337 Sep 09 21:37:38.757163 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 447/915] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:38 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:39.766875 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1c3b7b55-36ba-4c92-917f-6228f7e96f67 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:39.767605 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1c3b7b55-36ba-4c92-917f-6228f7e96f67 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:39.774127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c3b7b55-36ba-4c92-917f-6228f7e96f67 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:39.774615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c3b7b55-36ba-4c92-917f-6228f7e96f67 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:39.775047 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c3b7b55-36ba-4c92-917f-6228f7e96f67 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:39.775768 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c3b7b55-36ba-4c92-917f-6228f7e96f67 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:39.776223 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c3b7b55-36ba-4c92-917f-6228f7e96f67 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:39.776642 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1c3b7b55-36ba-4c92-917f-6228f7e96f67 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:39.994222 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1c3b7b55-36ba-4c92-917f-6228f7e96f67 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:40.002485 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1c3b7b55-36ba-4c92-917f-6228f7e96f67 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1367 microversion: 2.1 time: 0.240128 Sep 09 21:37:40.003043 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 469/916] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:39 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:40.401889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-7c170774-e3c9-49ee-8eb0-e1f70055bfcf req-e6b73fcb-7c3d-465e-82a8-6580a9b82cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d540826-35c1-46aa-935a-fa409f5a64f6", "tag": "16cf60d2-14f2-49d2-ab16-ed02e17aecc7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:37:40.412148 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-7c170774-e3c9-49ee-8eb0-e1f70055bfcf req-e6b73fcb-7c3d-465e-82a8-6580a9b82cb0 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:40.412628 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-7c170774-e3c9-49ee-8eb0-e1f70055bfcf req-e6b73fcb-7c3d-465e-82a8-6580a9b82cb0 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:40.413056 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-7c170774-e3c9-49ee-8eb0-e1f70055bfcf req-e6b73fcb-7c3d-465e-82a8-6580a9b82cb0 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:40.424691 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-7c170774-e3c9-49ee-8eb0-e1f70055bfcf req-e6b73fcb-7c3d-465e-82a8-6580a9b82cb0 service nova] Creating event network-changed:16cf60d2-14f2-49d2-ab16-ed02e17aecc7 for instance 4d540826-35c1-46aa-935a-fa409f5a64f6 on hv-cinder-85221 Sep 09 21:37:40.430018 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-7c170774-e3c9-49ee-8eb0-e1f70055bfcf req-e6b73fcb-7c3d-465e-82a8-6580a9b82cb0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102571 Sep 09 21:37:40.430725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 448/917] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:37:41.025872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6474c4c9-6cae-4363-acfc-e5cae1fa86b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:41.026507 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6474c4c9-6cae-4363-acfc-e5cae1fa86b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:41.033824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6474c4c9-6cae-4363-acfc-e5cae1fa86b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:41.034310 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6474c4c9-6cae-4363-acfc-e5cae1fa86b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:41.034746 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6474c4c9-6cae-4363-acfc-e5cae1fa86b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:41.035721 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6474c4c9-6cae-4363-acfc-e5cae1fa86b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:41.036180 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6474c4c9-6cae-4363-acfc-e5cae1fa86b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:41.036606 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6474c4c9-6cae-4363-acfc-e5cae1fa86b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:41.162582 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6474c4c9-6cae-4363-acfc-e5cae1fa86b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:41.170466 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6474c4c9-6cae-4363-acfc-e5cae1fa86b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1367 microversion: 2.1 time: 0.148501 Sep 09 21:37:41.171025 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 470/918] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:41 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:42.193818 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-48490316-f7bc-4b94-b78a-620bb23fb44c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:42.194455 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-48490316-f7bc-4b94-b78a-620bb23fb44c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:42.201403 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48490316-f7bc-4b94-b78a-620bb23fb44c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:42.201953 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48490316-f7bc-4b94-b78a-620bb23fb44c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:42.202385 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48490316-f7bc-4b94-b78a-620bb23fb44c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:42.203068 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48490316-f7bc-4b94-b78a-620bb23fb44c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:42.203520 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48490316-f7bc-4b94-b78a-620bb23fb44c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:42.203969 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-48490316-f7bc-4b94-b78a-620bb23fb44c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:42.334539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-48490316-f7bc-4b94-b78a-620bb23fb44c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:42.342134 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-48490316-f7bc-4b94-b78a-620bb23fb44c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1367 microversion: 2.1 time: 0.153015 Sep 09 21:37:42.342724 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 449/919] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:42 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:43.364739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-366c94b2-5bbd-4827-abeb-348ffeca51d9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:43.365340 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-366c94b2-5bbd-4827-abeb-348ffeca51d9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:43.371737 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-366c94b2-5bbd-4827-abeb-348ffeca51d9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:43.372240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-366c94b2-5bbd-4827-abeb-348ffeca51d9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:43.372682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-366c94b2-5bbd-4827-abeb-348ffeca51d9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:43.373377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-366c94b2-5bbd-4827-abeb-348ffeca51d9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:43.373833 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-366c94b2-5bbd-4827-abeb-348ffeca51d9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:43.374254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-366c94b2-5bbd-4827-abeb-348ffeca51d9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:43.624299 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-366c94b2-5bbd-4827-abeb-348ffeca51d9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:43.641798 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-366c94b2-5bbd-4827-abeb-348ffeca51d9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1367 microversion: 2.1 time: 0.280872 Sep 09 21:37:43.642384 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 471/920] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:43 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:44.664341 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a1fb1ea9-0539-4e9d-be50-1d8d1c9152a6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:44.664952 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a1fb1ea9-0539-4e9d-be50-1d8d1c9152a6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:44.671336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1fb1ea9-0539-4e9d-be50-1d8d1c9152a6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:44.671882 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1fb1ea9-0539-4e9d-be50-1d8d1c9152a6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:44.672321 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1fb1ea9-0539-4e9d-be50-1d8d1c9152a6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:44.673006 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1fb1ea9-0539-4e9d-be50-1d8d1c9152a6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:44.673455 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1fb1ea9-0539-4e9d-be50-1d8d1c9152a6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:44.673876 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a1fb1ea9-0539-4e9d-be50-1d8d1c9152a6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:44.803735 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a1fb1ea9-0539-4e9d-be50-1d8d1c9152a6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:44.811326 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a1fb1ea9-0539-4e9d-be50-1d8d1c9152a6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1367 microversion: 2.1 time: 0.151045 Sep 09 21:37:44.811926 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 450/921] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:44 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:45.201953 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-0fcc6629-7659-447e-ab06-d0c0bd4287a2 req-bad4e907-a1db-4471-bd99-1abb5843f49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d540826-35c1-46aa-935a-fa409f5a64f6", "name": "network-vif-plugged", "status": "completed", "tag": "16cf60d2-14f2-49d2-ab16-ed02e17aecc7"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:37:45.212262 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-0fcc6629-7659-447e-ab06-d0c0bd4287a2 req-bad4e907-a1db-4471-bd99-1abb5843f49b service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:45.212741 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-0fcc6629-7659-447e-ab06-d0c0bd4287a2 req-bad4e907-a1db-4471-bd99-1abb5843f49b service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:45.213164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-0fcc6629-7659-447e-ab06-d0c0bd4287a2 req-bad4e907-a1db-4471-bd99-1abb5843f49b service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:45.224669 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-0fcc6629-7659-447e-ab06-d0c0bd4287a2 req-bad4e907-a1db-4471-bd99-1abb5843f49b service nova] Creating event network-vif-plugged:16cf60d2-14f2-49d2-ab16-ed02e17aecc7 for instance 4d540826-35c1-46aa-935a-fa409f5a64f6 on hv-cinder-85221 Sep 09 21:37:45.229623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-0fcc6629-7659-447e-ab06-d0c0bd4287a2 req-bad4e907-a1db-4471-bd99-1abb5843f49b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090943 Sep 09 21:37:45.230201 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 472/922] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:37:45.834259 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6b1a3ff7-4073-421d-b79b-8d577b82a386 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:45.834877 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6b1a3ff7-4073-421d-b79b-8d577b82a386 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:45.842332 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b1a3ff7-4073-421d-b79b-8d577b82a386 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:45.842751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b1a3ff7-4073-421d-b79b-8d577b82a386 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:45.843190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b1a3ff7-4073-421d-b79b-8d577b82a386 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:45.843918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b1a3ff7-4073-421d-b79b-8d577b82a386 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:45.844381 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b1a3ff7-4073-421d-b79b-8d577b82a386 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:45.844814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6b1a3ff7-4073-421d-b79b-8d577b82a386 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:45.974879 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6b1a3ff7-4073-421d-b79b-8d577b82a386 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:45.982995 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6b1a3ff7-4073-421d-b79b-8d577b82a386 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1367 microversion: 2.1 time: 0.152619 Sep 09 21:37:45.983566 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 451/923] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:45 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:47.006448 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-15256824-96cb-46a2-a2b8-986ee6869e6f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:47.007152 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-15256824-96cb-46a2-a2b8-986ee6869e6f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:47.016643 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-15256824-96cb-46a2-a2b8-986ee6869e6f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:47.017132 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-15256824-96cb-46a2-a2b8-986ee6869e6f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:47.017565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-15256824-96cb-46a2-a2b8-986ee6869e6f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:47.018257 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-15256824-96cb-46a2-a2b8-986ee6869e6f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:47.018711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-15256824-96cb-46a2-a2b8-986ee6869e6f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:47.019133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-15256824-96cb-46a2-a2b8-986ee6869e6f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:47.186885 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-15256824-96cb-46a2-a2b8-986ee6869e6f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:47.195570 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-15256824-96cb-46a2-a2b8-986ee6869e6f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1367 microversion: 2.1 time: 0.193293 Sep 09 21:37:47.196152 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 473/924] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:47 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:48.219736 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e8ffef32-19b4-4e4e-bd8e-5f21e6991082 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:48.220341 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e8ffef32-19b4-4e4e-bd8e-5f21e6991082 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:48.222721 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:48.223376 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:48.229137 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e8ffef32-19b4-4e4e-bd8e-5f21e6991082 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:48.229624 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e8ffef32-19b4-4e4e-bd8e-5f21e6991082 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:48.230060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e8ffef32-19b4-4e4e-bd8e-5f21e6991082 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:48.230744 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e8ffef32-19b4-4e4e-bd8e-5f21e6991082 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:48.231204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e8ffef32-19b4-4e4e-bd8e-5f21e6991082 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:48.231656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e8ffef32-19b4-4e4e-bd8e-5f21e6991082 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:48.363141 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e8ffef32-19b4-4e4e-bd8e-5f21e6991082 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:48.370747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e8ffef32-19b4-4e4e-bd8e-5f21e6991082 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1557 microversion: 2.1 time: 0.154842 Sep 09 21:37:48.371296 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 452/925] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:48 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:48.394116 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-74892086-baa4-477f-9740-3ea37a12e3e4 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:48.394633 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-74892086-baa4-477f-9740-3ea37a12e3e4 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:48.396686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=6 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:48.402256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74892086-baa4-477f-9740-3ea37a12e3e4 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:48.402743 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74892086-baa4-477f-9740-3ea37a12e3e4 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:48.403329 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74892086-baa4-477f-9740-3ea37a12e3e4 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:48.404141 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74892086-baa4-477f-9740-3ea37a12e3e4 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:48.404502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74892086-baa4-477f-9740-3ea37a12e3e4 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:48.404934 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-74892086-baa4-477f-9740-3ea37a12e3e4 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:48.484032 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-74892086-baa4-477f-9740-3ea37a12e3e4 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093618 Sep 09 21:37:48.484615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 474/926] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 21:37:48 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:37:49.427366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-b5cd66f8-d78a-4332-a24c-ab118079c32e req-b3c09f6b-5bc5-40ad-b7c1-de1699b102c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d540826-35c1-46aa-935a-fa409f5a64f6", "tag": "16cf60d2-14f2-49d2-ab16-ed02e17aecc7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:37:49.437842 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b5cd66f8-d78a-4332-a24c-ab118079c32e req-b3c09f6b-5bc5-40ad-b7c1-de1699b102c2 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:49.438331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b5cd66f8-d78a-4332-a24c-ab118079c32e req-b3c09f6b-5bc5-40ad-b7c1-de1699b102c2 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:49.438768 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-b5cd66f8-d78a-4332-a24c-ab118079c32e req-b3c09f6b-5bc5-40ad-b7c1-de1699b102c2 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:49.449731 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-b5cd66f8-d78a-4332-a24c-ab118079c32e req-b3c09f6b-5bc5-40ad-b7c1-de1699b102c2 service nova] Creating event network-changed:16cf60d2-14f2-49d2-ab16-ed02e17aecc7 for instance 4d540826-35c1-46aa-935a-fa409f5a64f6 on hv-cinder-85221 Sep 09 21:37:49.455618 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-b5cd66f8-d78a-4332-a24c-ab118079c32e req-b3c09f6b-5bc5-40ad-b7c1-de1699b102c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031501 Sep 09 21:37:49.456219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 453/927] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:37:56.675960 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7e50995d-2cbe-42c2-84dd-c639459442df tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:56.676503 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7e50995d-2cbe-42c2-84dd-c639459442df tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:56.678266 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:56.686054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e50995d-2cbe-42c2-84dd-c639459442df tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:56.686540 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e50995d-2cbe-42c2-84dd-c639459442df tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:56.686979 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e50995d-2cbe-42c2-84dd-c639459442df tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:56.687699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e50995d-2cbe-42c2-84dd-c639459442df tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:56.688156 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e50995d-2cbe-42c2-84dd-c639459442df tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:56.688582 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7e50995d-2cbe-42c2-84dd-c639459442df tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:56.713364 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7e50995d-2cbe-42c2-84dd-c639459442df tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:37:56.792545 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7e50995d-2cbe-42c2-84dd-c639459442df tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 204 len: 0 microversion: 2.1 time: 0.120744 Sep 09 21:37:56.793437 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 475/928] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:37:56 2022] DELETE /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:37:56.805782 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4ab7ce0b-b3a0-4db7-a366-306c3b7b061a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:56.806471 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4ab7ce0b-b3a0-4db7-a366-306c3b7b061a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:56.814564 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ab7ce0b-b3a0-4db7-a366-306c3b7b061a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:56.815051 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ab7ce0b-b3a0-4db7-a366-306c3b7b061a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:56.815488 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ab7ce0b-b3a0-4db7-a366-306c3b7b061a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:56.816204 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ab7ce0b-b3a0-4db7-a366-306c3b7b061a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:56.816664 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ab7ce0b-b3a0-4db7-a366-306c3b7b061a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:56.817091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4ab7ce0b-b3a0-4db7-a366-306c3b7b061a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:56.958832 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-4ab7ce0b-b3a0-4db7-a366-306c3b7b061a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:56.967039 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4ab7ce0b-b3a0-4db7-a366-306c3b7b061a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1576 microversion: 2.1 time: 0.167911 Sep 09 21:37:56.967635 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 454/929] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:56 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:37:57.991311 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c82a0b80-6c78-475a-94fd-c1c85f44c942 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:57.992044 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c82a0b80-6c78-475a-94fd-c1c85f44c942 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:57.999350 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c82a0b80-6c78-475a-94fd-c1c85f44c942 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:57.999859 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c82a0b80-6c78-475a-94fd-c1c85f44c942 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:58.000300 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c82a0b80-6c78-475a-94fd-c1c85f44c942 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:58.000982 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c82a0b80-6c78-475a-94fd-c1c85f44c942 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:58.001441 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c82a0b80-6c78-475a-94fd-c1c85f44c942 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:58.001866 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c82a0b80-6c78-475a-94fd-c1c85f44c942 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:58.136367 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c82a0b80-6c78-475a-94fd-c1c85f44c942 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:58.144799 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c82a0b80-6c78-475a-94fd-c1c85f44c942 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1576 microversion: 2.1 time: 0.157946 Sep 09 21:37:58.145355 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 476/930] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:57 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:59.168090 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a4eff43b-6dd4-491e-a582-15dbf7465c91 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:37:59.168665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a4eff43b-6dd4-491e-a582-15dbf7465c91 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:37:59.171668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:59.177680 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4eff43b-6dd4-491e-a582-15dbf7465c91 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:59.178188 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4eff43b-6dd4-491e-a582-15dbf7465c91 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:59.178657 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4eff43b-6dd4-491e-a582-15dbf7465c91 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:59.179364 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4eff43b-6dd4-491e-a582-15dbf7465c91 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:59.179893 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4eff43b-6dd4-491e-a582-15dbf7465c91 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:59.180327 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a4eff43b-6dd4-491e-a582-15dbf7465c91 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:59.184916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:37:59.250035 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a4eff43b-6dd4-491e-a582-15dbf7465c91 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:37:59.259952 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a4eff43b-6dd4-491e-a582-15dbf7465c91 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1509 microversion: 2.1 time: 0.095647 Sep 09 21:37:59.270446 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 455/931] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:37:59 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1509 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:37:59.528746 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-72cd36d5-9f9b-4c13-87f8-b62e112c5fb1 req-fbec1bc3-31d8-4dff-91a2-db6949c411f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc844a55-4e91-445f-8de9-c8ff4e9af66b", "name": "network-vif-deleted", "tag": "e8928d59-873a-4d3e-8f9d-f1d136839c2e"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:37:59.539706 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-72cd36d5-9f9b-4c13-87f8-b62e112c5fb1 req-fbec1bc3-31d8-4dff-91a2-db6949c411f3 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:37:59.540275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-72cd36d5-9f9b-4c13-87f8-b62e112c5fb1 req-fbec1bc3-31d8-4dff-91a2-db6949c411f3 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:37:59.540938 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-72cd36d5-9f9b-4c13-87f8-b62e112c5fb1 req-fbec1bc3-31d8-4dff-91a2-db6949c411f3 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:37:59.553810 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-72cd36d5-9f9b-4c13-87f8-b62e112c5fb1 req-fbec1bc3-31d8-4dff-91a2-db6949c411f3 service nova] Creating event network-vif-deleted:e8928d59-873a-4d3e-8f9d-f1d136839c2e for instance bc844a55-4e91-445f-8de9-c8ff4e9af66b on hv-cinder-85221 Sep 09 21:37:59.559704 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-72cd36d5-9f9b-4c13-87f8-b62e112c5fb1 req-fbec1bc3-31d8-4dff-91a2-db6949c411f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035049 Sep 09 21:37:59.563212 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 477/932] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:38:00.282591 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:00.283200 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:00.291126 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:00.291645 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:00.292087 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:00.292777 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:00.293232 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:00.293650 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:00.327586 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:00.328079 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:00.328513 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:00.328958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lazy-loading 'fault' on Instance uuid bc844a55-4e91-445f-8de9-c8ff4e9af66b {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:38:00.370175 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:00.378531 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-fbfc508f-72dd-44a1-af90-d991c6b2cc2e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 200 len: 1230 microversion: 2.1 time: 0.099989 Sep 09 21:38:00.379685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 456/933] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:00 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:01.403140 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:01.404777 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:01.411571 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:01.412058 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:01.412496 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:01.413190 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:01.413651 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:01.414076 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:01.427793 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] HTTP exception thrown: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Request method failure captured: Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b HTTP/1.1 Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7FfON-ccvRMDYJKxIU0eVME27-XOMI6ONjxEjjKkLVy7f6bJSr9ENB_6_GufjBGoUXDT3pEC7RoAjcdzkpWaB5PUKxykiLHOSb7qm_mFklL1kXYY8edWwYS0rcG4b5L2VVQTAJiIeuL4E0Mt0dcXyIQ32m-uNV9BBI7YR-ha6vO8UY Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: b9a36910972a4d87b508b918af36bbd5 Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-TestVolumeBootPattern-23828200 Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:38:01.429406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9a36910972a4d87b508b918af36bbd5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9a36910972a4d87b508b918af36bbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9a36910972a4d87b508b918af36bbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9a36910972a4d87b508b918af36bbd5"}]}] Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-TestVolumeBootPattern-23828200 Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: b9a36910972a4d87b508b918af36bbd5 Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-TestVolumeBootPattern-23828200 Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-TestVolumeBootPattern-23828200-project Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 691a25c97f4748119366c35dd4688765 Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-TestVolumeBootPattern-23828200-project Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:38:01.431133 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': 'bc844a55-4e91-445f-8de9-c8ff4e9af66b'} Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:38:01.432130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:38:01.433682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:38:01.435208 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Returning 404 to user: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:38:01.435208 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-56c6afed-bc37-4fc9-b944-373cb7b0b577 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 404 len: 111 microversion: 2.1 time: 0.032408 Sep 09 21:38:01.435208 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 478/934] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:01 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:38:01.526865 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-692789544", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-225754611", "security_groups": [{"name": "tempest-secgroup-smoke-445796257"}], "block_device_mapping_v2": [{"uuid": "dcb90b8d-3948-4aa3-a77c-8db11f0f69aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f0bd4c9c-2c7c-4b69-bda5-7da8485a7c26"}]}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:38:01.644824 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] validate_networks() for [('f0bd4c9c-2c7c-4b69-bda5-7da8485a7c26', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:38:02.250249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:38:02.250670 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:38:02.251139 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:38:02.251577 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:38:02.251987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:38:02.260611 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:02.261086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:02.261518 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:02.262241 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:02.263282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:02.263839 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:02.280539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Getting quotas for project b9a36910972a4d87b508b918af36bbd5. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:38:02.284353 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Getting quotas for user 691a25c97f4748119366c35dd4688765 and project b9a36910972a4d87b508b918af36bbd5. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:38:02.340319 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:38:02.342487 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dcb90b8d-3948-4aa3-a77c-8db11f0f69aa',volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:38:02.472194 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3db4261c-a179-45bd-905f-122b28f14793 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.949268 Sep 09 21:38:02.473001 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 457/935] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:38:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:38:02.484207 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7a97967a-34b3-4211-b771-601a351b7260 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:02.484827 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7a97967a-34b3-4211-b771-601a351b7260 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:02.544731 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7a97967a-34b3-4211-b771-601a351b7260 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:02.552705 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7a97967a-34b3-4211-b771-601a351b7260 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1093 microversion: 2.1 time: 0.072724 Sep 09 21:38:02.553304 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 479/936] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:02 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:03.575662 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b6359c52-81e6-470a-b2c0-397136b7f122 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:03.576282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b6359c52-81e6-470a-b2c0-397136b7f122 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:03.582656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6359c52-81e6-470a-b2c0-397136b7f122 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:03.583151 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6359c52-81e6-470a-b2c0-397136b7f122 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:03.583616 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6359c52-81e6-470a-b2c0-397136b7f122 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:03.584317 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6359c52-81e6-470a-b2c0-397136b7f122 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:03.584776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6359c52-81e6-470a-b2c0-397136b7f122 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:03.585206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b6359c52-81e6-470a-b2c0-397136b7f122 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:03.652521 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b6359c52-81e6-470a-b2c0-397136b7f122 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:03.660712 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b6359c52-81e6-470a-b2c0-397136b7f122 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1199 microversion: 2.1 time: 0.089420 Sep 09 21:38:03.668262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 458/937] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:03 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1199 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:04.685110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-cdad3d1d-5745-4dab-851d-afa50b044572 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:04.685872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-cdad3d1d-5745-4dab-851d-afa50b044572 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:04.693192 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cdad3d1d-5745-4dab-851d-afa50b044572 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:04.693685 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cdad3d1d-5745-4dab-851d-afa50b044572 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:04.694127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cdad3d1d-5745-4dab-851d-afa50b044572 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:04.694835 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cdad3d1d-5745-4dab-851d-afa50b044572 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:04.695285 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cdad3d1d-5745-4dab-851d-afa50b044572 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:04.695765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-cdad3d1d-5745-4dab-851d-afa50b044572 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:04.927447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-cdad3d1d-5745-4dab-851d-afa50b044572 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:04.935188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-cdad3d1d-5745-4dab-851d-afa50b044572 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.254130 Sep 09 21:38:04.935769 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 480/938] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:04 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:05.212774 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b99bba5c-b256-4431-b03e-52e231dc00f8 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:38:05.215131 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b99bba5c-b256-4431-b03e-52e231dc00f8 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:05.222525 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b99bba5c-b256-4431-b03e-52e231dc00f8 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:05.223021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b99bba5c-b256-4431-b03e-52e231dc00f8 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:05.223466 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b99bba5c-b256-4431-b03e-52e231dc00f8 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:05.224195 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b99bba5c-b256-4431-b03e-52e231dc00f8 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:05.224647 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b99bba5c-b256-4431-b03e-52e231dc00f8 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:05.225073 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b99bba5c-b256-4431-b03e-52e231dc00f8 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:05.300513 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b99bba5c-b256-4431-b03e-52e231dc00f8 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "POST /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/action" status: 202 len: 0 microversion: 2.1 time: 0.091465 Sep 09 21:38:05.304378 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 459/939] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:38:05 2022] POST /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:38:05.311399 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ce32221f-a140-45de-85fe-3ae22e193ec9 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:05.312148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ce32221f-a140-45de-85fe-3ae22e193ec9 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:05.319049 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce32221f-a140-45de-85fe-3ae22e193ec9 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:05.319758 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce32221f-a140-45de-85fe-3ae22e193ec9 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:05.320442 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce32221f-a140-45de-85fe-3ae22e193ec9 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:05.321135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce32221f-a140-45de-85fe-3ae22e193ec9 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:05.321897 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce32221f-a140-45de-85fe-3ae22e193ec9 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:05.322406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ce32221f-a140-45de-85fe-3ae22e193ec9 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:05.418078 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-efd6ddd0-a6b3-4099-806a-dc4688a26ac3 req-9d87b4eb-7728-4415-888a-0bf96bbc66a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394a5227-01ae-4083-957d-1fe7d267a71f", "tag": "4fa80268-fdbb-44c1-8d74-a9162a890e21"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:38:05.429233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-efd6ddd0-a6b3-4099-806a-dc4688a26ac3 req-9d87b4eb-7728-4415-888a-0bf96bbc66a4 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:05.429824 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-efd6ddd0-a6b3-4099-806a-dc4688a26ac3 req-9d87b4eb-7728-4415-888a-0bf96bbc66a4 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:05.430257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-efd6ddd0-a6b3-4099-806a-dc4688a26ac3 req-9d87b4eb-7728-4415-888a-0bf96bbc66a4 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:05.442233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-efd6ddd0-a6b3-4099-806a-dc4688a26ac3 req-9d87b4eb-7728-4415-888a-0bf96bbc66a4 service nova] Creating event network-changed:4fa80268-fdbb-44c1-8d74-a9162a890e21 for instance 394a5227-01ae-4083-957d-1fe7d267a71f on hv-cinder-85221 Sep 09 21:38:05.447366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-efd6ddd0-a6b3-4099-806a-dc4688a26ac3 req-9d87b4eb-7728-4415-888a-0bf96bbc66a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033327 Sep 09 21:38:05.447990 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 460/940] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:38:05.622697 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ce32221f-a140-45de-85fe-3ae22e193ec9 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:05.632379 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ce32221f-a140-45de-85fe-3ae22e193ec9 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1750 microversion: 2.1 time: 0.326556 Sep 09 21:38:05.632957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 481/941] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:05 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1750 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:05.959249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-14b14c8b-6e0c-4998-a572-c744cc6d7049 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:05.959981 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-14b14c8b-6e0c-4998-a572-c744cc6d7049 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:05.966046 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14b14c8b-6e0c-4998-a572-c744cc6d7049 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:05.966758 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14b14c8b-6e0c-4998-a572-c744cc6d7049 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:05.967207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14b14c8b-6e0c-4998-a572-c744cc6d7049 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:05.967949 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14b14c8b-6e0c-4998-a572-c744cc6d7049 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:05.968404 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14b14c8b-6e0c-4998-a572-c744cc6d7049 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:05.968832 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-14b14c8b-6e0c-4998-a572-c744cc6d7049 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:06.099158 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-14b14c8b-6e0c-4998-a572-c744cc6d7049 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:06.107574 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-14b14c8b-6e0c-4998-a572-c744cc6d7049 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.151671 Sep 09 21:38:06.108147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 461/942] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:05 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:06.657738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-56e68a0e-12b7-4665-9363-609cc4385dea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:06.658357 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-56e68a0e-12b7-4665-9363-609cc4385dea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:06.665113 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56e68a0e-12b7-4665-9363-609cc4385dea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:06.665543 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56e68a0e-12b7-4665-9363-609cc4385dea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:06.665986 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56e68a0e-12b7-4665-9363-609cc4385dea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:06.666678 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56e68a0e-12b7-4665-9363-609cc4385dea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:06.667139 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56e68a0e-12b7-4665-9363-609cc4385dea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:06.667593 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56e68a0e-12b7-4665-9363-609cc4385dea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:06.889795 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-56e68a0e-12b7-4665-9363-609cc4385dea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:06.898125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-56e68a0e-12b7-4665-9363-609cc4385dea tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1750 microversion: 2.1 time: 0.245129 Sep 09 21:38:06.898691 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 482/943] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:06 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1750 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:07.130726 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-708c4834-7415-427b-a61a-fb52e1fa37b1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:07.131343 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-708c4834-7415-427b-a61a-fb52e1fa37b1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:07.137798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-708c4834-7415-427b-a61a-fb52e1fa37b1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:07.138840 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-708c4834-7415-427b-a61a-fb52e1fa37b1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:07.139215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-708c4834-7415-427b-a61a-fb52e1fa37b1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:07.139929 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-708c4834-7415-427b-a61a-fb52e1fa37b1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:07.140390 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-708c4834-7415-427b-a61a-fb52e1fa37b1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:07.140818 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-708c4834-7415-427b-a61a-fb52e1fa37b1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:07.344247 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-708c4834-7415-427b-a61a-fb52e1fa37b1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:07.351936 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-708c4834-7415-427b-a61a-fb52e1fa37b1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.225245 Sep 09 21:38:07.352529 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 462/944] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:07 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:07.922462 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d4b96156-13c1-455f-8e18-5842fd9710b4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:07.923101 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d4b96156-13c1-455f-8e18-5842fd9710b4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:07.929438 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4b96156-13c1-455f-8e18-5842fd9710b4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:07.929916 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4b96156-13c1-455f-8e18-5842fd9710b4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:07.930348 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4b96156-13c1-455f-8e18-5842fd9710b4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:07.931033 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4b96156-13c1-455f-8e18-5842fd9710b4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:07.931485 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4b96156-13c1-455f-8e18-5842fd9710b4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:07.931923 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d4b96156-13c1-455f-8e18-5842fd9710b4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:07.934481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:08.075809 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d4b96156-13c1-455f-8e18-5842fd9710b4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:08.083944 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d4b96156-13c1-455f-8e18-5842fd9710b4 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1755 microversion: 2.1 time: 0.165493 Sep 09 21:38:08.084497 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 483/945] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:07 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:08.374858 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9c7695b5-c96f-4dcf-8dbd-e81a7a17c89f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:08.375429 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9c7695b5-c96f-4dcf-8dbd-e81a7a17c89f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:08.381785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c7695b5-c96f-4dcf-8dbd-e81a7a17c89f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:08.382269 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c7695b5-c96f-4dcf-8dbd-e81a7a17c89f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:08.382705 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c7695b5-c96f-4dcf-8dbd-e81a7a17c89f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:08.383390 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c7695b5-c96f-4dcf-8dbd-e81a7a17c89f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:08.383877 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c7695b5-c96f-4dcf-8dbd-e81a7a17c89f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:08.384304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9c7695b5-c96f-4dcf-8dbd-e81a7a17c89f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:08.516669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-9c7695b5-c96f-4dcf-8dbd-e81a7a17c89f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:08.524271 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9c7695b5-c96f-4dcf-8dbd-e81a7a17c89f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.153995 Sep 09 21:38:08.524824 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 463/946] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:08 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:09.109011 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-216c300c-24b8-49a4-8552-8bbe8b9745eb tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:09.110000 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-216c300c-24b8-49a4-8552-8bbe8b9745eb tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:09.116397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-216c300c-24b8-49a4-8552-8bbe8b9745eb tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:09.116875 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-216c300c-24b8-49a4-8552-8bbe8b9745eb tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:09.117307 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-216c300c-24b8-49a4-8552-8bbe8b9745eb tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:09.117997 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-216c300c-24b8-49a4-8552-8bbe8b9745eb tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:09.118443 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-216c300c-24b8-49a4-8552-8bbe8b9745eb tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:09.118865 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-216c300c-24b8-49a4-8552-8bbe8b9745eb tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:09.268367 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-216c300c-24b8-49a4-8552-8bbe8b9745eb tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:09.276796 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-216c300c-24b8-49a4-8552-8bbe8b9745eb tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1755 microversion: 2.1 time: 0.172405 Sep 09 21:38:09.277359 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 484/947] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:09 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:09.546516 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b4534bbb-f337-4944-9adc-2501147e0249 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:09.547069 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b4534bbb-f337-4944-9adc-2501147e0249 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:09.553449 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b4534bbb-f337-4944-9adc-2501147e0249 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:09.553921 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b4534bbb-f337-4944-9adc-2501147e0249 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:09.554390 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b4534bbb-f337-4944-9adc-2501147e0249 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:09.555071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b4534bbb-f337-4944-9adc-2501147e0249 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:09.555551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b4534bbb-f337-4944-9adc-2501147e0249 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:09.555968 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b4534bbb-f337-4944-9adc-2501147e0249 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:09.838594 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b4534bbb-f337-4944-9adc-2501147e0249 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:09.846293 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b4534bbb-f337-4944-9adc-2501147e0249 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.303895 Sep 09 21:38:09.846847 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 464/948] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:09 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:10.300256 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e8feb01b-b7d8-4d36-b3c8-41e9e8871266 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:10.300895 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e8feb01b-b7d8-4d36-b3c8-41e9e8871266 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:10.307471 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8feb01b-b7d8-4d36-b3c8-41e9e8871266 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:10.307992 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8feb01b-b7d8-4d36-b3c8-41e9e8871266 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:10.308434 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8feb01b-b7d8-4d36-b3c8-41e9e8871266 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:10.309124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8feb01b-b7d8-4d36-b3c8-41e9e8871266 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:10.309589 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8feb01b-b7d8-4d36-b3c8-41e9e8871266 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:10.310252 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e8feb01b-b7d8-4d36-b3c8-41e9e8871266 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:10.449888 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e8feb01b-b7d8-4d36-b3c8-41e9e8871266 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:10.458671 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e8feb01b-b7d8-4d36-b3c8-41e9e8871266 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1755 microversion: 2.1 time: 0.162143 Sep 09 21:38:10.459179 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 485/949] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:10 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:10.869719 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-b3630071-fce8-4c54-b389-68aa6d302585 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:10.870276 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-b3630071-fce8-4c54-b389-68aa6d302585 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:10.877698 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3630071-fce8-4c54-b389-68aa6d302585 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:10.878179 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3630071-fce8-4c54-b389-68aa6d302585 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:10.878614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3630071-fce8-4c54-b389-68aa6d302585 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:10.879293 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3630071-fce8-4c54-b389-68aa6d302585 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:10.879788 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3630071-fce8-4c54-b389-68aa6d302585 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:10.880211 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-b3630071-fce8-4c54-b389-68aa6d302585 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:11.017373 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-b3630071-fce8-4c54-b389-68aa6d302585 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:11.024991 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-b3630071-fce8-4c54-b389-68aa6d302585 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.159227 Sep 09 21:38:11.025542 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 465/950] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:10 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:11.482695 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-66d8503d-5eca-4dec-81b3-65e493a9e653 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:11.483932 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-66d8503d-5eca-4dec-81b3-65e493a9e653 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:11.490237 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-66d8503d-5eca-4dec-81b3-65e493a9e653 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:11.490721 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-66d8503d-5eca-4dec-81b3-65e493a9e653 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:11.491156 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-66d8503d-5eca-4dec-81b3-65e493a9e653 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:11.491880 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-66d8503d-5eca-4dec-81b3-65e493a9e653 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:11.492333 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-66d8503d-5eca-4dec-81b3-65e493a9e653 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:11.492762 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-66d8503d-5eca-4dec-81b3-65e493a9e653 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:11.642218 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-66d8503d-5eca-4dec-81b3-65e493a9e653 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:11.650330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-66d8503d-5eca-4dec-81b3-65e493a9e653 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1755 microversion: 2.1 time: 0.171528 Sep 09 21:38:11.650914 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 486/951] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:11 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:12.048026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c616f120-351a-4fcf-96f8-fec473d8586c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:12.048638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c616f120-351a-4fcf-96f8-fec473d8586c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:12.055013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c616f120-351a-4fcf-96f8-fec473d8586c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:12.055437 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c616f120-351a-4fcf-96f8-fec473d8586c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:12.055901 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c616f120-351a-4fcf-96f8-fec473d8586c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:12.056583 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c616f120-351a-4fcf-96f8-fec473d8586c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:12.057036 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c616f120-351a-4fcf-96f8-fec473d8586c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:12.057456 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c616f120-351a-4fcf-96f8-fec473d8586c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:12.189607 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c616f120-351a-4fcf-96f8-fec473d8586c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:12.197258 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c616f120-351a-4fcf-96f8-fec473d8586c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.153868 Sep 09 21:38:12.197806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 466/952] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:12 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:12.674627 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b9b15d71-3a85-4c0f-9966-5434ab322378 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:12.675177 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b9b15d71-3a85-4c0f-9966-5434ab322378 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:12.677080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:12.682560 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9b15d71-3a85-4c0f-9966-5434ab322378 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:12.683038 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9b15d71-3a85-4c0f-9966-5434ab322378 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:12.683468 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9b15d71-3a85-4c0f-9966-5434ab322378 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:12.684175 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9b15d71-3a85-4c0f-9966-5434ab322378 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:12.684649 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9b15d71-3a85-4c0f-9966-5434ab322378 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:12.685071 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b9b15d71-3a85-4c0f-9966-5434ab322378 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:12.828722 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b9b15d71-3a85-4c0f-9966-5434ab322378 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:12.836913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b9b15d71-3a85-4c0f-9966-5434ab322378 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1755 microversion: 2.1 time: 0.166432 Sep 09 21:38:12.837478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 487/953] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:12 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:13.220769 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-49f1a2a9-7cb2-4bf7-9535-59b2bb0ea4e6 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:13.221526 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-49f1a2a9-7cb2-4bf7-9535-59b2bb0ea4e6 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:13.223562 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:13.224499 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:13.231850 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f1a2a9-7cb2-4bf7-9535-59b2bb0ea4e6 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:13.232337 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f1a2a9-7cb2-4bf7-9535-59b2bb0ea4e6 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:13.233305 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f1a2a9-7cb2-4bf7-9535-59b2bb0ea4e6 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:13.234444 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f1a2a9-7cb2-4bf7-9535-59b2bb0ea4e6 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:13.234930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f1a2a9-7cb2-4bf7-9535-59b2bb0ea4e6 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:13.235366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f1a2a9-7cb2-4bf7-9535-59b2bb0ea4e6 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:13.371456 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-49f1a2a9-7cb2-4bf7-9535-59b2bb0ea4e6 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:13.379919 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-49f1a2a9-7cb2-4bf7-9535-59b2bb0ea4e6 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.163321 Sep 09 21:38:13.380612 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 467/954] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:13 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:13.861418 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-9310bf69-b464-452f-929a-672d6704444d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:13.862036 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-9310bf69-b464-452f-929a-672d6704444d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:13.868390 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9310bf69-b464-452f-929a-672d6704444d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:13.868875 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9310bf69-b464-452f-929a-672d6704444d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:13.869306 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9310bf69-b464-452f-929a-672d6704444d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:13.869998 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9310bf69-b464-452f-929a-672d6704444d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:13.870449 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9310bf69-b464-452f-929a-672d6704444d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:13.870873 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-9310bf69-b464-452f-929a-672d6704444d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:14.017079 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-9310bf69-b464-452f-929a-672d6704444d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:14.025401 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-9310bf69-b464-452f-929a-672d6704444d tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1755 microversion: 2.1 time: 0.168557 Sep 09 21:38:14.025971 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 488/955] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:13 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:14.402413 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2f01eb92-c918-4792-aa0b-7ce7812e7f75 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:14.403036 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2f01eb92-c918-4792-aa0b-7ce7812e7f75 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:14.410268 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f01eb92-c918-4792-aa0b-7ce7812e7f75 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:14.410787 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f01eb92-c918-4792-aa0b-7ce7812e7f75 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:14.411233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f01eb92-c918-4792-aa0b-7ce7812e7f75 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:14.412208 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f01eb92-c918-4792-aa0b-7ce7812e7f75 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:14.412671 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f01eb92-c918-4792-aa0b-7ce7812e7f75 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:14.413102 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f01eb92-c918-4792-aa0b-7ce7812e7f75 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:14.543291 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-2f01eb92-c918-4792-aa0b-7ce7812e7f75 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:14.551992 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2f01eb92-c918-4792-aa0b-7ce7812e7f75 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.153382 Sep 09 21:38:14.552540 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 468/956] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:14 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:15.050012 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-dd3d829c-5d39-446f-af26-004f62f9c013 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:15.050637 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-dd3d829c-5d39-446f-af26-004f62f9c013 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:15.057608 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dd3d829c-5d39-446f-af26-004f62f9c013 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:15.058099 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dd3d829c-5d39-446f-af26-004f62f9c013 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:15.058536 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dd3d829c-5d39-446f-af26-004f62f9c013 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:15.059227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dd3d829c-5d39-446f-af26-004f62f9c013 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:15.059725 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dd3d829c-5d39-446f-af26-004f62f9c013 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:15.060153 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-dd3d829c-5d39-446f-af26-004f62f9c013 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:15.207855 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-dd3d829c-5d39-446f-af26-004f62f9c013 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:15.216249 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-dd3d829c-5d39-446f-af26-004f62f9c013 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1755 microversion: 2.1 time: 0.170513 Sep 09 21:38:15.216913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 489/957] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:15 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:15.329159 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-4588e3e9-0260-4aa3-a636-aed374462505 req-e7e80ccd-210a-4b8a-8c86-a8665c773911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394a5227-01ae-4083-957d-1fe7d267a71f", "name": "network-vif-plugged", "status": "completed", "tag": "4fa80268-fdbb-44c1-8d74-a9162a890e21"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:38:15.338471 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-4588e3e9-0260-4aa3-a636-aed374462505 req-e7e80ccd-210a-4b8a-8c86-a8665c773911 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:15.339117 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-4588e3e9-0260-4aa3-a636-aed374462505 req-e7e80ccd-210a-4b8a-8c86-a8665c773911 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:15.339407 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-4588e3e9-0260-4aa3-a636-aed374462505 req-e7e80ccd-210a-4b8a-8c86-a8665c773911 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:15.350845 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-4588e3e9-0260-4aa3-a636-aed374462505 req-e7e80ccd-210a-4b8a-8c86-a8665c773911 service nova] Creating event network-vif-plugged:4fa80268-fdbb-44c1-8d74-a9162a890e21 for instance 394a5227-01ae-4083-957d-1fe7d267a71f on hv-cinder-85221 Sep 09 21:38:15.355791 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-4588e3e9-0260-4aa3-a636-aed374462505 req-e7e80ccd-210a-4b8a-8c86-a8665c773911 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030972 Sep 09 21:38:15.356550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 469/958] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:38:15.574931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-56cbb0b4-8082-4ec1-85f2-812c69dec4ce tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:15.575460 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-56cbb0b4-8082-4ec1-85f2-812c69dec4ce tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:15.581977 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56cbb0b4-8082-4ec1-85f2-812c69dec4ce tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:15.582470 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56cbb0b4-8082-4ec1-85f2-812c69dec4ce tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:15.582909 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56cbb0b4-8082-4ec1-85f2-812c69dec4ce tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:15.583635 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56cbb0b4-8082-4ec1-85f2-812c69dec4ce tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:15.584097 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56cbb0b4-8082-4ec1-85f2-812c69dec4ce tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:15.584523 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-56cbb0b4-8082-4ec1-85f2-812c69dec4ce tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:15.719717 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-56cbb0b4-8082-4ec1-85f2-812c69dec4ce tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:15.727463 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-56cbb0b4-8082-4ec1-85f2-812c69dec4ce tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.156330 Sep 09 21:38:15.728267 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 490/959] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:15 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:16.241491 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5396c200-d1bd-4c6d-9b6d-715c49a1ad04 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:16.242219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5396c200-d1bd-4c6d-9b6d-715c49a1ad04 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:16.248284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5396c200-d1bd-4c6d-9b6d-715c49a1ad04 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:16.248861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5396c200-d1bd-4c6d-9b6d-715c49a1ad04 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:16.249336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5396c200-d1bd-4c6d-9b6d-715c49a1ad04 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:16.250015 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5396c200-d1bd-4c6d-9b6d-715c49a1ad04 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:16.250467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5396c200-d1bd-4c6d-9b6d-715c49a1ad04 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:16.250891 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5396c200-d1bd-4c6d-9b6d-715c49a1ad04 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:16.395883 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-5396c200-d1bd-4c6d-9b6d-715c49a1ad04 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:16.403844 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5396c200-d1bd-4c6d-9b6d-715c49a1ad04 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1755 microversion: 2.1 time: 0.166996 Sep 09 21:38:16.404393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 470/960] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:16 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:16.750981 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5f622d9f-4762-4c2c-ba22-a4c8ae6c2ee1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:16.751618 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5f622d9f-4762-4c2c-ba22-a4c8ae6c2ee1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:16.757972 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5f622d9f-4762-4c2c-ba22-a4c8ae6c2ee1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:16.758481 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5f622d9f-4762-4c2c-ba22-a4c8ae6c2ee1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:16.758911 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5f622d9f-4762-4c2c-ba22-a4c8ae6c2ee1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:16.759614 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5f622d9f-4762-4c2c-ba22-a4c8ae6c2ee1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:16.760070 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5f622d9f-4762-4c2c-ba22-a4c8ae6c2ee1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:16.760491 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5f622d9f-4762-4c2c-ba22-a4c8ae6c2ee1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:16.893357 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-5f622d9f-4762-4c2c-ba22-a4c8ae6c2ee1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:16.900959 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5f622d9f-4762-4c2c-ba22-a4c8ae6c2ee1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1264 microversion: 2.1 time: 0.154578 Sep 09 21:38:16.901521 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 491/961] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:16 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:17.427934 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e6daebb8-ef7d-4ae6-95a5-07e79b7d713e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:17.428572 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e6daebb8-ef7d-4ae6-95a5-07e79b7d713e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:17.434868 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6daebb8-ef7d-4ae6-95a5-07e79b7d713e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:17.435350 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6daebb8-ef7d-4ae6-95a5-07e79b7d713e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:17.435812 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6daebb8-ef7d-4ae6-95a5-07e79b7d713e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:17.436719 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6daebb8-ef7d-4ae6-95a5-07e79b7d713e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:17.437183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6daebb8-ef7d-4ae6-95a5-07e79b7d713e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:17.437606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6daebb8-ef7d-4ae6-95a5-07e79b7d713e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:17.587713 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-e6daebb8-ef7d-4ae6-95a5-07e79b7d713e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:17.596448 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e6daebb8-ef7d-4ae6-95a5-07e79b7d713e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1755 microversion: 2.1 time: 0.172352 Sep 09 21:38:17.597009 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 471/962] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:17 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:17.924142 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f89fe518-2670-4666-a487-3842e5d2d02e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:17.924756 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f89fe518-2670-4666-a487-3842e5d2d02e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:17.931110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f89fe518-2670-4666-a487-3842e5d2d02e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:17.931618 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f89fe518-2670-4666-a487-3842e5d2d02e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:17.932054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f89fe518-2670-4666-a487-3842e5d2d02e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:17.932729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f89fe518-2670-4666-a487-3842e5d2d02e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:17.933183 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f89fe518-2670-4666-a487-3842e5d2d02e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:17.933606 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f89fe518-2670-4666-a487-3842e5d2d02e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:18.064000 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f89fe518-2670-4666-a487-3842e5d2d02e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:18.071790 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f89fe518-2670-4666-a487-3842e5d2d02e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1451 microversion: 2.1 time: 0.152049 Sep 09 21:38:18.072350 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 492/963] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:17 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:18.094251 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-49f4ef05-97a3-46ba-9952-4ed98a905f63 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:18.094855 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-49f4ef05-97a3-46ba-9952-4ed98a905f63 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:18.100763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f4ef05-97a3-46ba-9952-4ed98a905f63 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:18.101243 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f4ef05-97a3-46ba-9952-4ed98a905f63 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:18.101677 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f4ef05-97a3-46ba-9952-4ed98a905f63 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:18.102375 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f4ef05-97a3-46ba-9952-4ed98a905f63 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:18.102841 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f4ef05-97a3-46ba-9952-4ed98a905f63 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:18.103262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-49f4ef05-97a3-46ba-9952-4ed98a905f63 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:18.118215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:38:18.241469 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-49f4ef05-97a3-46ba-9952-4ed98a905f63 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:18.249494 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-49f4ef05-97a3-46ba-9952-4ed98a905f63 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1451 microversion: 2.1 time: 0.159636 Sep 09 21:38:18.250054 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 472/964] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:18 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:18.621200 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-45fc3232-dad6-4180-b521-4c8bcf1fb5b6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:18.621763 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-45fc3232-dad6-4180-b521-4c8bcf1fb5b6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:18.628756 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc3232-dad6-4180-b521-4c8bcf1fb5b6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:18.629292 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc3232-dad6-4180-b521-4c8bcf1fb5b6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:18.629735 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc3232-dad6-4180-b521-4c8bcf1fb5b6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:18.630446 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc3232-dad6-4180-b521-4c8bcf1fb5b6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:18.630972 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc3232-dad6-4180-b521-4c8bcf1fb5b6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:18.631411 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-45fc3232-dad6-4180-b521-4c8bcf1fb5b6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:18.783208 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-45fc3232-dad6-4180-b521-4c8bcf1fb5b6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:18.791626 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-45fc3232-dad6-4180-b521-4c8bcf1fb5b6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1755 microversion: 2.1 time: 0.174392 Sep 09 21:38:18.792197 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 493/965] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:18 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:38:19.814458 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-25902ff2-546f-430a-8f0e-2823fb98f6f6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:38:19.815106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-25902ff2-546f-430a-8f0e-2823fb98f6f6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:38:19.821189 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25902ff2-546f-430a-8f0e-2823fb98f6f6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:19.821684 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25902ff2-546f-430a-8f0e-2823fb98f6f6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:19.822121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25902ff2-546f-430a-8f0e-2823fb98f6f6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:19.822903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25902ff2-546f-430a-8f0e-2823fb98f6f6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:19.823509 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25902ff2-546f-430a-8f0e-2823fb98f6f6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:19.823993 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25902ff2-546f-430a-8f0e-2823fb98f6f6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:19.897942 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-e5c9bb88-fec7-4ffe-b6d7-d2a26cc7efd3 req-0146443b-636d-44ba-b23b-3f76a628c28a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394a5227-01ae-4083-957d-1fe7d267a71f", "tag": "4fa80268-fdbb-44c1-8d74-a9162a890e21"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:38:19.909242 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-e5c9bb88-fec7-4ffe-b6d7-d2a26cc7efd3 req-0146443b-636d-44ba-b23b-3f76a628c28a service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:38:19.909727 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-e5c9bb88-fec7-4ffe-b6d7-d2a26cc7efd3 req-0146443b-636d-44ba-b23b-3f76a628c28a service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:38:19.910159 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-e5c9bb88-fec7-4ffe-b6d7-d2a26cc7efd3 req-0146443b-636d-44ba-b23b-3f76a628c28a service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:38:19.923822 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-e5c9bb88-fec7-4ffe-b6d7-d2a26cc7efd3 req-0146443b-636d-44ba-b23b-3f76a628c28a service nova] Creating event network-changed:4fa80268-fdbb-44c1-8d74-a9162a890e21 for instance 394a5227-01ae-4083-957d-1fe7d267a71f on hv-cinder-85221 Sep 09 21:38:19.929127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-e5c9bb88-fec7-4ffe-b6d7-d2a26cc7efd3 req-0146443b-636d-44ba-b23b-3f76a628c28a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034671 Sep 09 21:38:19.929730 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 494/966] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:38:19.989268 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-25902ff2-546f-430a-8f0e-2823fb98f6f6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:38:20.001012 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-25902ff2-546f-430a-8f0e-2823fb98f6f6 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1758 microversion: 2.1 time: 0.190533 Sep 09 21:38:20.001751 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 473/967] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:38:19 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:04.520531 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:04.521269 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=67 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:04.526130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-634e15b3-88c4-4461-b3a5-37b5a2720a18 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:04.526807 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-634e15b3-88c4-4461-b3a5-37b5a2720a18 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:04.534158 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-634e15b3-88c4-4461-b3a5-37b5a2720a18 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:04.534637 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-634e15b3-88c4-4461-b3a5-37b5a2720a18 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:04.535068 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-634e15b3-88c4-4461-b3a5-37b5a2720a18 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:04.535773 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-634e15b3-88c4-4461-b3a5-37b5a2720a18 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:04.536224 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-634e15b3-88c4-4461-b3a5-37b5a2720a18 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:04.536645 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-634e15b3-88c4-4461-b3a5-37b5a2720a18 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:04.560104 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-634e15b3-88c4-4461-b3a5-37b5a2720a18 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6/ips" status: 200 len: 150 microversion: 2.1 time: 0.041628 Sep 09 21:39:04.560651 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 495/968] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:39:04 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:39:04.572918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ace41d65-6cc7-48af-ba58-a7432fcc2ddc"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:04.575190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:04.577417 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:04.578746 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=9 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:04.584762 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:04.585249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:04.585685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:04.586369 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:04.586825 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:04.587250 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:04.666424 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Invalid volume: volume ace41d65-6cc7-48af-ba58-a7432fcc2ddc is already attached to instances: 8ac7aa13-bffc-474e-aef4-ee08d9428655 Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: POST /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6/os-volume_attachments HTTP/1.1 Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 74 Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:39:04.668205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {"volumeAttachment": {"volumeId": "ace41d65-6cc7-48af-ba58-a7432fcc2ddc"}} Sep 09 21:39:04.669838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Invalid volume: volume ace41d65-6cc7-48af-ba58-a7432fcc2ddc is already attached to instances: 8ac7aa13-bffc-474e-aef4-ee08d9428655 Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'server_id': '4d540826-35c1-46aa-935a-fa409f5a64f6', 'body': {'volumeAttachment': {'volumeId': 'ace41d65-6cc7-48af-ba58-a7432fcc2ddc'}}} Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ace41d65-6cc7-48af-ba58-a7432fcc2ddc is already attached to instances: 8ac7aa13-bffc-474e-aef4-ee08d9428655 Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:39:04.670822 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ace41d65-6cc7-48af-ba58-a7432fcc2ddc is already attached to instances: 8ac7aa13-bffc-474e-aef4-ee08d9428655 Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:04.672498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:39:04.674190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:39:04.674190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:39:04.674190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:39:04.674190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ace41d65-6cc7-48af-ba58-a7432fcc2ddc is already attached to instances: 8ac7aa13-bffc-474e-aef4-ee08d9428655 Sep 09 21:39:04.674190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:39:04.674190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 400 to user: Invalid volume: volume ace41d65-6cc7-48af-ba58-a7432fcc2ddc is already attached to instances: 8ac7aa13-bffc-474e-aef4-ee08d9428655 {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:39:04.674190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-530ec68e-8ec7-4c85-82b7-211a418f4cf0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100652 Sep 09 21:39:04.674190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 474/969] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:39:04 2022] POST /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:39:04.678420 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5865d9a1-4452-446c-97bb-d026591c4bc3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:04.678922 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5865d9a1-4452-446c-97bb-d026591c4bc3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:04.684829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5865d9a1-4452-446c-97bb-d026591c4bc3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:04.685314 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5865d9a1-4452-446c-97bb-d026591c4bc3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:04.685753 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5865d9a1-4452-446c-97bb-d026591c4bc3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:04.686440 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5865d9a1-4452-446c-97bb-d026591c4bc3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:04.686902 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5865d9a1-4452-446c-97bb-d026591c4bc3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:04.687330 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5865d9a1-4452-446c-97bb-d026591c4bc3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:04.712787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5865d9a1-4452-446c-97bb-d026591c4bc3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:39:04.785805 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5865d9a1-4452-446c-97bb-d026591c4bc3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 204 len: 0 microversion: 2.1 time: 0.110866 Sep 09 21:39:04.786380 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 496/970] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:39:04 2022] DELETE /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:39:04.795367 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a33e13eb-d030-481a-acce-eedc01142ee7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:04.796002 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a33e13eb-d030-481a-acce-eedc01142ee7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:04.802930 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a33e13eb-d030-481a-acce-eedc01142ee7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:04.803417 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a33e13eb-d030-481a-acce-eedc01142ee7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:04.803881 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a33e13eb-d030-481a-acce-eedc01142ee7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:04.804567 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a33e13eb-d030-481a-acce-eedc01142ee7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:04.805026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a33e13eb-d030-481a-acce-eedc01142ee7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:04.805455 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a33e13eb-d030-481a-acce-eedc01142ee7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:04.934685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a33e13eb-d030-481a-acce-eedc01142ee7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:04.943043 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a33e13eb-d030-481a-acce-eedc01142ee7 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1682 microversion: 2.1 time: 0.151849 Sep 09 21:39:04.943620 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 475/971] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:04 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:39:05.967574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0b4d6641-6607-4e03-be87-7b3c8e2fb2f2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:05.968281 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0b4d6641-6607-4e03-be87-7b3c8e2fb2f2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:05.975369 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b4d6641-6607-4e03-be87-7b3c8e2fb2f2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:05.975890 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b4d6641-6607-4e03-be87-7b3c8e2fb2f2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:05.976319 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b4d6641-6607-4e03-be87-7b3c8e2fb2f2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:05.977043 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b4d6641-6607-4e03-be87-7b3c8e2fb2f2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:05.977585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b4d6641-6607-4e03-be87-7b3c8e2fb2f2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:05.978008 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0b4d6641-6607-4e03-be87-7b3c8e2fb2f2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:06.107734 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0b4d6641-6607-4e03-be87-7b3c8e2fb2f2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:06.115722 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0b4d6641-6607-4e03-be87-7b3c8e2fb2f2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1682 microversion: 2.1 time: 0.152310 Sep 09 21:39:06.116277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 497/972] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:05 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:07.141904 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-67aafc38-358c-4018-bafe-5330dcea74ce tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:07.142552 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-67aafc38-358c-4018-bafe-5330dcea74ce tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:07.148885 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67aafc38-358c-4018-bafe-5330dcea74ce tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:07.149385 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67aafc38-358c-4018-bafe-5330dcea74ce tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:07.149815 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67aafc38-358c-4018-bafe-5330dcea74ce tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:07.150508 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67aafc38-358c-4018-bafe-5330dcea74ce tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:07.150961 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67aafc38-358c-4018-bafe-5330dcea74ce tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:07.151388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-67aafc38-358c-4018-bafe-5330dcea74ce tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:07.366871 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-67aafc38-358c-4018-bafe-5330dcea74ce tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:07.374682 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-67aafc38-358c-4018-bafe-5330dcea74ce tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1682 microversion: 2.1 time: 0.237285 Sep 09 21:39:07.375455 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 476/973] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:07 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:07.701328 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-71a52497-a182-4fc6-828b-822f3b295e20 req-a80e9bb5-3d54-4634-a913-449a29f4f5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d540826-35c1-46aa-935a-fa409f5a64f6", "name": "network-vif-deleted", "tag": "16cf60d2-14f2-49d2-ab16-ed02e17aecc7"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:07.707781 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:39:07.707953 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Fri Sep 9 21:39:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Sep 09 21:39:07.720657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-71a52497-a182-4fc6-828b-822f3b295e20 req-a80e9bb5-3d54-4634-a913-449a29f4f5c6 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:07.721003 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-71a52497-a182-4fc6-828b-822f3b295e20 req-a80e9bb5-3d54-4634-a913-449a29f4f5c6 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:07.721736 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-71a52497-a182-4fc6-828b-822f3b295e20 req-a80e9bb5-3d54-4634-a913-449a29f4f5c6 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:07.737631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-71a52497-a182-4fc6-828b-822f3b295e20 req-a80e9bb5-3d54-4634-a913-449a29f4f5c6 service nova] Creating event network-vif-deleted:16cf60d2-14f2-49d2-ab16-ed02e17aecc7 for instance 4d540826-35c1-46aa-935a-fa409f5a64f6 on hv-cinder-85221 Sep 09 21:39:07.744172 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-71a52497-a182-4fc6-828b-822f3b295e20 req-a80e9bb5-3d54-4634-a913-449a29f4f5c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048325 Sep 09 21:39:07.745596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 498/974] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:39:08.398933 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:08.400346 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:08.403965 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:39:08.404138 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Fri Sep 9 21:39:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 (ip 10.222.0.46) !!! Sep 09 21:39:08.409833 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:08.410511 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:08.410953 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:08.411697 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:08.412160 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:08.412591 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:08.448187 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:08.448838 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:08.449615 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:08.450080 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lazy-loading 'fault' on Instance uuid 4d540826-35c1-46aa-935a-fa409f5a64f6 {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:39:08.496812 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:08.505100 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6c3112fd-2ef4-4534-902e-eb84c1758c42 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 200 len: 1331 microversion: 2.1 time: 0.110392 Sep 09 21:39:08.505661 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 477/975] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:08 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:09.529126 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:09.529828 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:09.536845 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:09.537338 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:09.537778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:09.538525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:09.539283 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:09.539759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:09.553457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 HTTP/1.1 Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:39:09.555131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:39:09.556877 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '4d540826-35c1-46aa-935a-fa409f5a64f6'} Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:39:09.557823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:39:09.559353 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:09.561567 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:39:09.561567 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ee52893e-2dcb-4255-aeed-02c16944b867 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 404 len: 111 microversion: 2.1 time: 0.031638 Sep 09 21:39:09.561567 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 499/976] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:09 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:39:09.565840 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6e3af66a-ee09-45fc-b8d6-e1141b598ce0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '.version_select at 0x7f0812db5790>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:09.587931 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6e3af66a-ee09-45fc-b8d6-e1141b598ce0 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054577772" status: 202 len: 0 microversion: 2.1 time: 0.026227 Sep 09 21:39:09.588503 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 478/977] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 21:39:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054577772 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:39:10.245670 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e3d749ff-c859-4311-b085-b4c9a733b27e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:10.246156 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e3d749ff-c859-4311-b085-b4c9a733b27e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:10.252594 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3d749ff-c859-4311-b085-b4c9a733b27e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:10.253058 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3d749ff-c859-4311-b085-b4c9a733b27e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:10.253502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3d749ff-c859-4311-b085-b4c9a733b27e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:10.254159 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3d749ff-c859-4311-b085-b4c9a733b27e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:10.254612 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3d749ff-c859-4311-b085-b4c9a733b27e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:10.255030 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e3d749ff-c859-4311-b085-b4c9a733b27e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:10.335194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-e3d749ff-c859-4311-b085-b4c9a733b27e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lazy-loading 'services' on Instance uuid 8ac7aa13-bffc-474e-aef4-ee08d9428655 {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:39:10.408798 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e3d749ff-c859-4311-b085-b4c9a733b27e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/os-volume_attachments/ace41d65-6cc7-48af-ba58-a7432fcc2ddc" status: 202 len: 0 microversion: 2.1 time: 0.166820 Sep 09 21:39:10.409364 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 500/978] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:39:10 2022] DELETE /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/os-volume_attachments/ace41d65-6cc7-48af-ba58-a7432fcc2ddc => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:39:10.418614 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5f345830-059d-40e6-8e55-ebcc9b2ff9aa tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:10.420812 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5f345830-059d-40e6-8e55-ebcc9b2ff9aa tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:10.430230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5f345830-059d-40e6-8e55-ebcc9b2ff9aa tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:10.430742 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5f345830-059d-40e6-8e55-ebcc9b2ff9aa tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:10.431175 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5f345830-059d-40e6-8e55-ebcc9b2ff9aa tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:10.431908 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5f345830-059d-40e6-8e55-ebcc9b2ff9aa tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:10.432366 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5f345830-059d-40e6-8e55-ebcc9b2ff9aa tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:10.432793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5f345830-059d-40e6-8e55-ebcc9b2ff9aa tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:10.463108 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5f345830-059d-40e6-8e55-ebcc9b2ff9aa tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049283 Sep 09 21:39:10.463689 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 479/979] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:39:10 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:39:11.477194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-24d9d756-7205-4f64-9238-be84b5a73d51 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:11.479502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-24d9d756-7205-4f64-9238-be84b5a73d51 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:11.486303 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d9d756-7205-4f64-9238-be84b5a73d51 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:11.486851 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d9d756-7205-4f64-9238-be84b5a73d51 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:11.487310 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d9d756-7205-4f64-9238-be84b5a73d51 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:11.488011 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d9d756-7205-4f64-9238-be84b5a73d51 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:11.488471 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d9d756-7205-4f64-9238-be84b5a73d51 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:11.488899 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-24d9d756-7205-4f64-9238-be84b5a73d51 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:11.519627 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-24d9d756-7205-4f64-9238-be84b5a73d51 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047166 Sep 09 21:39:11.520173 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 501/980] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:39:11 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:39:11.586403 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3e9e1edb-9c2b-4e5d-9cb2-03d95bfe1bd6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:11.586911 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3e9e1edb-9c2b-4e5d-9cb2-03d95bfe1bd6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:11.593192 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e9e1edb-9c2b-4e5d-9cb2-03d95bfe1bd6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:11.593682 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e9e1edb-9c2b-4e5d-9cb2-03d95bfe1bd6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:11.594119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e9e1edb-9c2b-4e5d-9cb2-03d95bfe1bd6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:11.595595 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e9e1edb-9c2b-4e5d-9cb2-03d95bfe1bd6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:11.596061 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e9e1edb-9c2b-4e5d-9cb2-03d95bfe1bd6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:11.596491 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e9e1edb-9c2b-4e5d-9cb2-03d95bfe1bd6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:11.620497 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3e9e1edb-9c2b-4e5d-9cb2-03d95bfe1bd6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:39:11.700889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3e9e1edb-9c2b-4e5d-9cb2-03d95bfe1bd6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 204 len: 0 microversion: 2.1 time: 0.117976 Sep 09 21:39:11.701459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 480/981] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:39:11 2022] DELETE /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:39:11.710188 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ff8c325a-2280-446c-9303-dec382a7523d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:11.710903 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ff8c325a-2280-446c-9303-dec382a7523d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:11.716762 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff8c325a-2280-446c-9303-dec382a7523d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:11.717236 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff8c325a-2280-446c-9303-dec382a7523d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:11.717666 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff8c325a-2280-446c-9303-dec382a7523d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:11.718341 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff8c325a-2280-446c-9303-dec382a7523d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:11.718791 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff8c325a-2280-446c-9303-dec382a7523d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:11.719260 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ff8c325a-2280-446c-9303-dec382a7523d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:11.852275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ff8c325a-2280-446c-9303-dec382a7523d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:11.860004 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ff8c325a-2280-446c-9303-dec382a7523d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1683 microversion: 2.1 time: 0.153566 Sep 09 21:39:11.860696 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 502/982] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:11 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:39:12.884112 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-83a554f5-b5b4-412d-9a17-7ec22b92fd11 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:12.884743 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-83a554f5-b5b4-412d-9a17-7ec22b92fd11 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:12.891050 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a554f5-b5b4-412d-9a17-7ec22b92fd11 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:12.892440 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a554f5-b5b4-412d-9a17-7ec22b92fd11 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:12.892892 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a554f5-b5b4-412d-9a17-7ec22b92fd11 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:12.893587 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a554f5-b5b4-412d-9a17-7ec22b92fd11 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:12.894047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a554f5-b5b4-412d-9a17-7ec22b92fd11 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:12.894480 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-83a554f5-b5b4-412d-9a17-7ec22b92fd11 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:13.023321 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-83a554f5-b5b4-412d-9a17-7ec22b92fd11 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:13.030987 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-83a554f5-b5b4-412d-9a17-7ec22b92fd11 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1683 microversion: 2.1 time: 0.151269 Sep 09 21:39:13.031556 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 481/983] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:12 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:14.054698 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b0159b3a-2101-4593-acb7-5efdb55f2fb9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:14.055408 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b0159b3a-2101-4593-acb7-5efdb55f2fb9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:14.061557 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0159b3a-2101-4593-acb7-5efdb55f2fb9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:14.062114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0159b3a-2101-4593-acb7-5efdb55f2fb9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:14.062840 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0159b3a-2101-4593-acb7-5efdb55f2fb9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:14.063365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0159b3a-2101-4593-acb7-5efdb55f2fb9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:14.063908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0159b3a-2101-4593-acb7-5efdb55f2fb9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:14.064406 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b0159b3a-2101-4593-acb7-5efdb55f2fb9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:14.194632 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b0159b3a-2101-4593-acb7-5efdb55f2fb9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:14.202683 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b0159b3a-2101-4593-acb7-5efdb55f2fb9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 200 len: 1683 microversion: 2.1 time: 0.151847 Sep 09 21:39:14.203179 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 503/984] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:14 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:14.546379 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-78263135-080a-4ca8-889f-0d93794a79e1 req-565421ab-f3c5-4ceb-a176-b5935f32a07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac7aa13-bffc-474e-aef4-ee08d9428655", "name": "network-vif-deleted", "tag": "a5e8e3e0-19dc-440b-865c-b3a30cd80dfe"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:14.560771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-78263135-080a-4ca8-889f-0d93794a79e1 req-565421ab-f3c5-4ceb-a176-b5935f32a07f service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:14.561412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-78263135-080a-4ca8-889f-0d93794a79e1 req-565421ab-f3c5-4ceb-a176-b5935f32a07f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:14.561849 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-78263135-080a-4ca8-889f-0d93794a79e1 req-565421ab-f3c5-4ceb-a176-b5935f32a07f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:14.574749 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-78263135-080a-4ca8-889f-0d93794a79e1 req-565421ab-f3c5-4ceb-a176-b5935f32a07f service nova] Creating event network-vif-deleted:a5e8e3e0-19dc-440b-865c-b3a30cd80dfe for instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 on hv-cinder-85221 Sep 09 21:39:14.583285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-78263135-080a-4ca8-889f-0d93794a79e1 req-565421ab-f3c5-4ceb-a176-b5935f32a07f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040625 Sep 09 21:39:14.583921 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 482/985] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:39:15.226955 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:15.228202 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:15.234380 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:15.235051 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:15.235971 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:15.237056 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:15.237522 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:15.237955 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:15.251909 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 HTTP/1.1 Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:39:15.253738 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:39:15.255455 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '8ac7aa13-bffc-474e-aef4-ee08d9428655'} Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:39:15.256729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:39:15.258274 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:15.261033 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:39:15.261033 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-005f8369-3412-4551-9139-19a3afffb00c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 404 len: 111 microversion: 2.1 time: 0.032164 Sep 09 21:39:15.261033 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 504/986] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:15 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:39:15.264393 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c196e35e-f84e-468f-b4b5-4de94fab3214 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '.version_select at 0x7f0812dba280>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:15.284939 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c196e35e-f84e-468f-b4b5-4de94fab3214 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039286858" status: 202 len: 0 microversion: 2.1 time: 0.024534 Sep 09 21:39:15.285515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 483/987] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 21:39:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039286858 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:39:15.916013 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b60fb845-8dd4-4587-a952-4a5738b575ae tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: .version_select at 0x7f0813036b80>, body: {"keypair": {"name": "tempest-keypair-958892321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcsFTbbiKQc83ujvYTFrC6Mteiqy7oI+v8Mn4r4JnB63xt/vv9ytIX6mQtAHklBGq+WCMoDJvtzy5oItiU/bD4YSNILfEKahQx+ZVRtWSe01lPtwihO7H6ZK7xAxve3zw=="}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:15.931127 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-b60fb845-8dd4-4587-a952-4a5738b575ae tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for project 7cca63adb761474d82636997dade783a. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:39:15.934987 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-b60fb845-8dd4-4587-a952-4a5738b575ae tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for user 70dcf397dc04470b9756119a9fe8f6a6 and project 7cca63adb761474d82636997dade783a. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:39:15.956962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b60fb845-8dd4-4587-a952-4a5738b575ae tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045122 Sep 09 21:39:15.957540 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 505/988] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 21:39:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:39:17.186352 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-602216895", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8b93671-3117-4194-8e44-7e685c00fc4d"}], "security_groups": [{"name": "tempest-securitygroup--827776031"}], "key_name": "tempest-keypair-958892321", "user_data": "}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:17.292241 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.network.neutron [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] validate_networks() for [('b8b93671-3117-4194-8e44-7e685c00fc4d', None, None, None, None, None)] {{(pid=120466) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:39:17.659575 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Flavor limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:39:17.660000 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Image limits 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:39:17.660472 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Flavor pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:39:17.660879 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Image pref 0:0:0 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:39:17.661287 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.virt.hardware [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:39:17.670404 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:17.670885 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:17.671317 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:17.672076 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:17.672557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:17.673013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:17.689373 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for project 7cca63adb761474d82636997dade783a. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:39:17.693304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.quota [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for user 70dcf397dc04470b9756119a9fe8f6a6 and project 7cca63adb761474d82636997dade783a. Resources: {'ram', 'instances', 'cores'} {{(pid=120466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:39:17.704969 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Going to run 1 instances... {{(pid=120466) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:39:17.707321 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:39:17.755716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-5fc8a2be-ce5a-4206-8275-fe4012b42b2c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.574059 Sep 09 21:39:17.756600 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 484/989] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:39:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:39:17.768265 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-576cdae1-2cdc-4a5d-9e05-268af24b20c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:17.768956 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-576cdae1-2cdc-4a5d-9e05-268af24b20c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:17.824232 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-576cdae1-2cdc-4a5d-9e05-268af24b20c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:17.831525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-576cdae1-2cdc-4a5d-9e05-268af24b20c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1240 microversion: 2.1 time: 0.067896 Sep 09 21:39:17.832104 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 506/990] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:17 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:39:18.854045 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6596bb24-68c6-4a33-a9bc-618b3ff44080 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:18.854665 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6596bb24-68c6-4a33-a9bc-618b3ff44080 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:18.861170 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6596bb24-68c6-4a33-a9bc-618b3ff44080 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:18.861655 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6596bb24-68c6-4a33-a9bc-618b3ff44080 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:18.862237 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6596bb24-68c6-4a33-a9bc-618b3ff44080 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:18.862908 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6596bb24-68c6-4a33-a9bc-618b3ff44080 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:18.863363 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6596bb24-68c6-4a33-a9bc-618b3ff44080 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:18.863817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6596bb24-68c6-4a33-a9bc-618b3ff44080 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:18.955022 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6596bb24-68c6-4a33-a9bc-618b3ff44080 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:18.964215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6596bb24-68c6-4a33-a9bc-618b3ff44080 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1300 microversion: 2.1 time: 0.114488 Sep 09 21:39:18.964887 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 485/991] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:18 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:19.987820 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-16244392-4b7d-4327-81e2-ab1bfee20a9d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:19.988430 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-16244392-4b7d-4327-81e2-ab1bfee20a9d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:19.994502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-16244392-4b7d-4327-81e2-ab1bfee20a9d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:19.994984 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-16244392-4b7d-4327-81e2-ab1bfee20a9d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:19.995422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-16244392-4b7d-4327-81e2-ab1bfee20a9d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:19.996131 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-16244392-4b7d-4327-81e2-ab1bfee20a9d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:19.996582 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-16244392-4b7d-4327-81e2-ab1bfee20a9d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:19.997001 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-16244392-4b7d-4327-81e2-ab1bfee20a9d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:20.143576 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-16244392-4b7d-4327-81e2-ab1bfee20a9d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:20.151218 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-16244392-4b7d-4327-81e2-ab1bfee20a9d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1365 microversion: 2.1 time: 0.167781 Sep 09 21:39:20.151890 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 507/992] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:19 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:20.557036 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-51de3a42-4136-4c77-a0ed-4e25bdabc4b5 req-11ebeb32-23e4-42a5-a102-9cc82b741ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ff12f3-8e9e-4811-b65a-0d1a1d15419f", "tag": "d2270997-af20-4f19-a9a2-0f55efd867c7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:20.567798 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-51de3a42-4136-4c77-a0ed-4e25bdabc4b5 req-11ebeb32-23e4-42a5-a102-9cc82b741ea2 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:20.568520 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-51de3a42-4136-4c77-a0ed-4e25bdabc4b5 req-11ebeb32-23e4-42a5-a102-9cc82b741ea2 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:20.568958 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-51de3a42-4136-4c77-a0ed-4e25bdabc4b5 req-11ebeb32-23e4-42a5-a102-9cc82b741ea2 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:20.587380 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-51de3a42-4136-4c77-a0ed-4e25bdabc4b5 req-11ebeb32-23e4-42a5-a102-9cc82b741ea2 service nova] Creating event network-changed:d2270997-af20-4f19-a9a2-0f55efd867c7 for instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f on hv-cinder-85221 Sep 09 21:39:20.593465 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-51de3a42-4136-4c77-a0ed-4e25bdabc4b5 req-11ebeb32-23e4-42a5-a102-9cc82b741ea2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040113 Sep 09 21:39:20.594279 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 486/993] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:39:21.175144 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-58b9ae31-50a4-43ce-adb0-41650079c31f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:21.175788 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-58b9ae31-50a4-43ce-adb0-41650079c31f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:21.182589 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-58b9ae31-50a4-43ce-adb0-41650079c31f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:21.183073 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-58b9ae31-50a4-43ce-adb0-41650079c31f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:21.183512 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-58b9ae31-50a4-43ce-adb0-41650079c31f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:21.184240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-58b9ae31-50a4-43ce-adb0-41650079c31f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:21.184720 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-58b9ae31-50a4-43ce-adb0-41650079c31f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:21.185180 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-58b9ae31-50a4-43ce-adb0-41650079c31f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:21.311653 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-58b9ae31-50a4-43ce-adb0-41650079c31f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:21.319388 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-58b9ae31-50a4-43ce-adb0-41650079c31f tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1365 microversion: 2.1 time: 0.149001 Sep 09 21:39:21.319979 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 508/994] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:21 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:22.343142 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ed5d802e-eb23-4a1b-b61a-181cf98859e3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:22.343911 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ed5d802e-eb23-4a1b-b61a-181cf98859e3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:22.351498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ed5d802e-eb23-4a1b-b61a-181cf98859e3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:22.352010 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ed5d802e-eb23-4a1b-b61a-181cf98859e3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:22.352442 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ed5d802e-eb23-4a1b-b61a-181cf98859e3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:22.353124 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ed5d802e-eb23-4a1b-b61a-181cf98859e3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:22.353576 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ed5d802e-eb23-4a1b-b61a-181cf98859e3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:22.353996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ed5d802e-eb23-4a1b-b61a-181cf98859e3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:22.486169 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ed5d802e-eb23-4a1b-b61a-181cf98859e3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:22.493805 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ed5d802e-eb23-4a1b-b61a-181cf98859e3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1365 microversion: 2.1 time: 0.154898 Sep 09 21:39:22.494363 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 487/995] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:22 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:23.404027 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2ac95587-cd1c-4ef6-a3f7-493320655632 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1789702605"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:23.404613 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2ac95587-cd1c-4ef6-a3f7-493320655632 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:23.411799 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ac95587-cd1c-4ef6-a3f7-493320655632 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:23.412304 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ac95587-cd1c-4ef6-a3f7-493320655632 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:23.412728 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ac95587-cd1c-4ef6-a3f7-493320655632 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:23.413437 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ac95587-cd1c-4ef6-a3f7-493320655632 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:23.413889 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ac95587-cd1c-4ef6-a3f7-493320655632 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:23.414313 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2ac95587-cd1c-4ef6-a3f7-493320655632 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:23.517356 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-7ed0a975-c532-4b5b-a268-c4156e4f34ee tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:23.518330 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-7ed0a975-c532-4b5b-a268-c4156e4f34ee tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:23.524885 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ed0a975-c532-4b5b-a268-c4156e4f34ee tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:23.525380 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ed0a975-c532-4b5b-a268-c4156e4f34ee tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:23.525823 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ed0a975-c532-4b5b-a268-c4156e4f34ee tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:23.526519 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ed0a975-c532-4b5b-a268-c4156e4f34ee tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:23.526982 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ed0a975-c532-4b5b-a268-c4156e4f34ee tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:23.527413 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7ed0a975-c532-4b5b-a268-c4156e4f34ee tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:23.542608 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.network.security_group_api [None req-2ac95587-cd1c-4ef6-a3f7-493320655632 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Removing security group acc53eaa-9c25-4411-bdb7-1831f8763d1b from port 3e813f66-d068-4e01-bb0e-c9e89d846726 Sep 09 21:39:23.724537 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7ed0a975-c532-4b5b-a268-c4156e4f34ee tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:23.734556 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-7ed0a975-c532-4b5b-a268-c4156e4f34ee tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1365 microversion: 2.1 time: 0.220233 Sep 09 21:39:23.735745 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 488/996] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:23 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:23.873309 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2ac95587-cd1c-4ef6-a3f7-493320655632 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "POST /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/action" status: 202 len: 0 microversion: 2.1 time: 0.473237 Sep 09 21:39:23.873940 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 509/997] 10.222.0.46 () {60 vars in 1278 bytes} [Fri Sep 9 21:39:23 2022] POST /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:39:23.887857 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-6717ef6c-3d1c-4152-9e40-75bee64663de req-f1cf9647-24fc-4a5e-9f3e-74ea9994a1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83882853-8b42-46e9-9059-823457adff9a", "tag": "3e813f66-d068-4e01-bb0e-c9e89d846726"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:23.897183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-6717ef6c-3d1c-4152-9e40-75bee64663de req-f1cf9647-24fc-4a5e-9f3e-74ea9994a1e5 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:23.897759 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-6717ef6c-3d1c-4152-9e40-75bee64663de req-f1cf9647-24fc-4a5e-9f3e-74ea9994a1e5 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:23.898668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-6717ef6c-3d1c-4152-9e40-75bee64663de req-f1cf9647-24fc-4a5e-9f3e-74ea9994a1e5 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:23.909948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-6717ef6c-3d1c-4152-9e40-75bee64663de req-f1cf9647-24fc-4a5e-9f3e-74ea9994a1e5 service nova] Creating event network-changed:3e813f66-d068-4e01-bb0e-c9e89d846726 for instance 83882853-8b42-46e9-9059-823457adff9a on hv-cinder-85221 Sep 09 21:39:23.915344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-6717ef6c-3d1c-4152-9e40-75bee64663de req-f1cf9647-24fc-4a5e-9f3e-74ea9994a1e5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031215 Sep 09 21:39:23.916229 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 489/998] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:39:24.758397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-eec837bb-49f2-4685-ba8f-5a1eb70b31c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:24.759002 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-eec837bb-49f2-4685-ba8f-5a1eb70b31c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:24.764925 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eec837bb-49f2-4685-ba8f-5a1eb70b31c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:24.765491 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eec837bb-49f2-4685-ba8f-5a1eb70b31c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:24.765921 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eec837bb-49f2-4685-ba8f-5a1eb70b31c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:24.766598 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eec837bb-49f2-4685-ba8f-5a1eb70b31c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:24.767048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eec837bb-49f2-4685-ba8f-5a1eb70b31c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:24.767468 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-eec837bb-49f2-4685-ba8f-5a1eb70b31c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:24.987285 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-eec837bb-49f2-4685-ba8f-5a1eb70b31c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:24.994903 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-eec837bb-49f2-4685-ba8f-5a1eb70b31c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1365 microversion: 2.1 time: 0.240873 Sep 09 21:39:24.995460 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 510/999] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:24 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:25.072657 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ff69590b-30bd-40e9-8f94-cd9fc0d0a93c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:25.073276 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ff69590b-30bd-40e9-8f94-cd9fc0d0a93c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:25.079401 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ff69590b-30bd-40e9-8f94-cd9fc0d0a93c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:25.080483 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ff69590b-30bd-40e9-8f94-cd9fc0d0a93c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:25.081160 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ff69590b-30bd-40e9-8f94-cd9fc0d0a93c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:25.081829 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ff69590b-30bd-40e9-8f94-cd9fc0d0a93c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:25.082293 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ff69590b-30bd-40e9-8f94-cd9fc0d0a93c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:25.082782 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ff69590b-30bd-40e9-8f94-cd9fc0d0a93c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:25.166230 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.objects.instance [None req-ff69590b-30bd-40e9-8f94-cd9fc0d0a93c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lazy-loading 'services' on Instance uuid 83882853-8b42-46e9-9059-823457adff9a {{(pid=120466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:39:25.239678 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ff69590b-30bd-40e9-8f94-cd9fc0d0a93c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "DELETE /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments/1672187d-2650-443e-af75-1d600e713728" status: 202 len: 0 microversion: 2.1 time: 0.171625 Sep 09 21:39:25.240584 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 490/1000] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:39:25 2022] DELETE /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments/1672187d-2650-443e-af75-1d600e713728 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:39:25.248457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-fe528893-2fbf-4aa1-97ec-c8fcfb839e9e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:25.250999 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-fe528893-2fbf-4aa1-97ec-c8fcfb839e9e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:25.257130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe528893-2fbf-4aa1-97ec-c8fcfb839e9e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:25.257689 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe528893-2fbf-4aa1-97ec-c8fcfb839e9e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:25.258189 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe528893-2fbf-4aa1-97ec-c8fcfb839e9e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:25.258968 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe528893-2fbf-4aa1-97ec-c8fcfb839e9e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:25.259564 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe528893-2fbf-4aa1-97ec-c8fcfb839e9e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:25.260169 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-fe528893-2fbf-4aa1-97ec-c8fcfb839e9e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:25.293824 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-fe528893-2fbf-4aa1-97ec-c8fcfb839e9e tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049183 Sep 09 21:39:25.294657 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 511/1001] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:39:25 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:39:25.933618 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-a169c285-4bcc-44d9-8c39-314af4bc1dcc req-3cc68437-0da2-4ffb-9e30-917f81ea2cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83882853-8b42-46e9-9059-823457adff9a", "tag": "3e813f66-d068-4e01-bb0e-c9e89d846726"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:25.944338 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-a169c285-4bcc-44d9-8c39-314af4bc1dcc req-3cc68437-0da2-4ffb-9e30-917f81ea2cca service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:25.944902 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-a169c285-4bcc-44d9-8c39-314af4bc1dcc req-3cc68437-0da2-4ffb-9e30-917f81ea2cca service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:25.945411 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-a169c285-4bcc-44d9-8c39-314af4bc1dcc req-3cc68437-0da2-4ffb-9e30-917f81ea2cca service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:25.956551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-a169c285-4bcc-44d9-8c39-314af4bc1dcc req-3cc68437-0da2-4ffb-9e30-917f81ea2cca service nova] Creating event network-changed:3e813f66-d068-4e01-bb0e-c9e89d846726 for instance 83882853-8b42-46e9-9059-823457adff9a on hv-cinder-85221 Sep 09 21:39:25.961457 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-a169c285-4bcc-44d9-8c39-314af4bc1dcc req-3cc68437-0da2-4ffb-9e30-917f81ea2cca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032076 Sep 09 21:39:25.962038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 491/1002] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:39:26.018382 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d8228147-77f1-4c92-bd70-092e3503507d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:26.018972 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d8228147-77f1-4c92-bd70-092e3503507d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:26.025575 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8228147-77f1-4c92-bd70-092e3503507d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:26.026313 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8228147-77f1-4c92-bd70-092e3503507d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:26.026749 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8228147-77f1-4c92-bd70-092e3503507d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:26.027445 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8228147-77f1-4c92-bd70-092e3503507d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:26.028040 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8228147-77f1-4c92-bd70-092e3503507d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:26.028631 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d8228147-77f1-4c92-bd70-092e3503507d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:26.182937 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-651f7539-5447-4191-801d-3092136f3446 req-d06d4cea-4cf9-4936-9cd8-f6e591b1c5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ff12f3-8e9e-4811-b65a-0d1a1d15419f", "name": "network-vif-plugged", "status": "completed", "tag": "d2270997-af20-4f19-a9a2-0f55efd867c7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:26.212161 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-651f7539-5447-4191-801d-3092136f3446 req-d06d4cea-4cf9-4936-9cd8-f6e591b1c5e6 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:26.212694 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-651f7539-5447-4191-801d-3092136f3446 req-d06d4cea-4cf9-4936-9cd8-f6e591b1c5e6 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:26.213733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-651f7539-5447-4191-801d-3092136f3446 req-d06d4cea-4cf9-4936-9cd8-f6e591b1c5e6 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:26.232140 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-651f7539-5447-4191-801d-3092136f3446 req-d06d4cea-4cf9-4936-9cd8-f6e591b1c5e6 service nova] Creating event network-vif-plugged:d2270997-af20-4f19-a9a2-0f55efd867c7 for instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f on hv-cinder-85221 Sep 09 21:39:26.239012 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-651f7539-5447-4191-801d-3092136f3446 req-d06d4cea-4cf9-4936-9cd8-f6e591b1c5e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061633 Sep 09 21:39:26.239844 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 492/1003] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:39:26.271436 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d8228147-77f1-4c92-bd70-092e3503507d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:26.281148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d8228147-77f1-4c92-bd70-092e3503507d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1365 microversion: 2.1 time: 0.267407 Sep 09 21:39:26.281729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 512/1004] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:26 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:26.308667 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3e7345b3-001b-4476-93a1-1209d678a6af tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:26.311074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-3e7345b3-001b-4476-93a1-1209d678a6af tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:26.318118 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e7345b3-001b-4476-93a1-1209d678a6af tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:26.318618 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e7345b3-001b-4476-93a1-1209d678a6af tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:26.319061 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e7345b3-001b-4476-93a1-1209d678a6af tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:26.319793 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e7345b3-001b-4476-93a1-1209d678a6af tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:26.320253 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e7345b3-001b-4476-93a1-1209d678a6af tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:26.320687 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-3e7345b3-001b-4476-93a1-1209d678a6af tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:26.349164 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:26.354428 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3e7345b3-001b-4476-93a1-1209d678a6af tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050148 Sep 09 21:39:26.355214 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 493/1005] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:39:26 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 21:39:26.367773 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:26.370759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:26.380775 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:26.381517 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:26.381963 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:26.382854 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:26.383492 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:26.384048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:26.478068 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:26.482031 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] HTTP exception thrown: Instance 83882853-8b42-46e9-9059-823457adff9a is not attached to volume 1672187d-2650-443e-af75-1d600e713728 Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Request method failure captured: Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: DELETE /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments/1672187d-2650-443e-af75-1d600e713728 HTTP/1.1 Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7HNCus7d--i2KLcmqV8pGgJ863wuMoGZlNUvbvf-HXob_MBfXekWiLY0ZSb4QLj5mv7lTKpUXAo-zoBYOeBH0BHQEnb3NR94q-LZbgExVPJfdTga-IhLV0AoFBitHp1-MAaHUBB3A3_AYSbUdhJP_0SssvYISlv23VEtwhhc9LthUY Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 91a4df4888bc427ab3f8195e68604c96 Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-TestMinimumBasicScenario-544809831 Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:39:26.484792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_91a4df4888bc427ab3f8195e68604c96", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/91a4df4888bc427ab3f8195e68604c96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/91a4df4888bc427ab3f8195e68604c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/91a4df4888bc427ab3f8195e68604c96"}]}] Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-TestMinimumBasicScenario-544809831 Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 91a4df4888bc427ab3f8195e68604c96 Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-TestMinimumBasicScenario-544809831 Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-TestMinimumBasicScenario-544809831-project Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 4654c5c4e09e4c25ab58aca20cfcc7e2 Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-TestMinimumBasicScenario-544809831-project Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:39:26.487712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 83882853-8b42-46e9-9059-823457adff9a is not attached to volume 1672187d-2650-443e-af75-1d600e713728 Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'server_id': '83882853-8b42-46e9-9059-823457adff9a', 'id': '1672187d-2650-443e-af75-1d600e713728'} Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1672187d-2650-443e-af75-1d600e713728. Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:39:26.489596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83882853-8b42-46e9-9059-823457adff9a is not attached to volume 1672187d-2650-443e-af75-1d600e713728 Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83882853-8b42-46e9-9059-823457adff9a is not attached to volume 1672187d-2650-443e-af75-1d600e713728 Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:39:26.491166 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Returning 404 to user: Instance 83882853-8b42-46e9-9059-823457adff9a is not attached to volume 1672187d-2650-443e-af75-1d600e713728 {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:39:26.493590 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b350f64b-1738-44d1-ba8c-35c0c8f2e18c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "DELETE /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments/1672187d-2650-443e-af75-1d600e713728" status: 404 len: 154 microversion: 2.1 time: 0.124351 Sep 09 21:39:26.493590 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 513/1006] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:39:26 2022] DELETE /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a/os-volume_attachments/1672187d-2650-443e-af75-1d600e713728 => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:39:27.305921 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0c4a7893-06b1-4a69-b712-701d94402a78 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:27.306468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0c4a7893-06b1-4a69-b712-701d94402a78 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:27.315417 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0c4a7893-06b1-4a69-b712-701d94402a78 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:27.316011 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0c4a7893-06b1-4a69-b712-701d94402a78 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:27.316451 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0c4a7893-06b1-4a69-b712-701d94402a78 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:27.317150 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0c4a7893-06b1-4a69-b712-701d94402a78 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:27.317607 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0c4a7893-06b1-4a69-b712-701d94402a78 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:27.318038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0c4a7893-06b1-4a69-b712-701d94402a78 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:27.452323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0c4a7893-06b1-4a69-b712-701d94402a78 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:27.459916 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0c4a7893-06b1-4a69-b712-701d94402a78 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1365 microversion: 2.1 time: 0.157928 Sep 09 21:39:27.460582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 494/1007] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:27 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:27.658972 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4fa3a196-95bd-4b99-9a27-1d267185084f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:27.659475 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4fa3a196-95bd-4b99-9a27-1d267185084f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:27.666895 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4fa3a196-95bd-4b99-9a27-1d267185084f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:27.667377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4fa3a196-95bd-4b99-9a27-1d267185084f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:27.667839 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4fa3a196-95bd-4b99-9a27-1d267185084f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:27.668524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4fa3a196-95bd-4b99-9a27-1d267185084f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:27.668989 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4fa3a196-95bd-4b99-9a27-1d267185084f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:27.669411 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4fa3a196-95bd-4b99-9a27-1d267185084f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:27.695169 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4fa3a196-95bd-4b99-9a27-1d267185084f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:39:27.773313 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4fa3a196-95bd-4b99-9a27-1d267185084f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "DELETE /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 204 len: 0 microversion: 2.1 time: 0.118405 Sep 09 21:39:27.773871 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 514/1008] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:39:27 2022] DELETE /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:39:27.783923 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-0cb703a6-0225-4307-8286-999c0a02914a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:27.784655 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-0cb703a6-0225-4307-8286-999c0a02914a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:27.786482 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:27.787165 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=6 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:27.793321 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0cb703a6-0225-4307-8286-999c0a02914a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:27.793813 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0cb703a6-0225-4307-8286-999c0a02914a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:27.794255 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0cb703a6-0225-4307-8286-999c0a02914a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:27.794961 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0cb703a6-0225-4307-8286-999c0a02914a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:27.795411 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0cb703a6-0225-4307-8286-999c0a02914a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:27.795867 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-0cb703a6-0225-4307-8286-999c0a02914a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:27.923385 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-0cb703a6-0225-4307-8286-999c0a02914a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:27.931577 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-0cb703a6-0225-4307-8286-999c0a02914a tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1552 microversion: 2.1 time: 0.153189 Sep 09 21:39:27.932136 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 495/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:27 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:28.482786 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a2ea0691-ca83-4fdd-be9c-9bc7e8cce30d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:28.483488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a2ea0691-ca83-4fdd-be9c-9bc7e8cce30d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:28.485522 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=6 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:39:28.491242 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a2ea0691-ca83-4fdd-be9c-9bc7e8cce30d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:28.491759 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a2ea0691-ca83-4fdd-be9c-9bc7e8cce30d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:28.492235 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a2ea0691-ca83-4fdd-be9c-9bc7e8cce30d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:28.492907 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a2ea0691-ca83-4fdd-be9c-9bc7e8cce30d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:28.493371 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a2ea0691-ca83-4fdd-be9c-9bc7e8cce30d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:28.493831 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a2ea0691-ca83-4fdd-be9c-9bc7e8cce30d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:28.620941 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a2ea0691-ca83-4fdd-be9c-9bc7e8cce30d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:28.629165 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a2ea0691-ca83-4fdd-be9c-9bc7e8cce30d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1365 microversion: 2.1 time: 0.150598 Sep 09 21:39:28.629736 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 515/1010] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:28 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:28.954852 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-299ea7e2-6376-4ba3-9ece-105f5b783325 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:28.955524 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-299ea7e2-6376-4ba3-9ece-105f5b783325 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:28.962005 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-299ea7e2-6376-4ba3-9ece-105f5b783325 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:28.962486 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-299ea7e2-6376-4ba3-9ece-105f5b783325 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:28.962918 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-299ea7e2-6376-4ba3-9ece-105f5b783325 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:28.963688 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-299ea7e2-6376-4ba3-9ece-105f5b783325 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:28.964141 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-299ea7e2-6376-4ba3-9ece-105f5b783325 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:28.964564 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-299ea7e2-6376-4ba3-9ece-105f5b783325 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:29.094993 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-299ea7e2-6376-4ba3-9ece-105f5b783325 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:29.102720 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-299ea7e2-6376-4ba3-9ece-105f5b783325 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1552 microversion: 2.1 time: 0.151723 Sep 09 21:39:29.103282 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 496/1011] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:28 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:29.652380 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-6d267f38-9f74-44e4-8694-d73b77fa5ec8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:29.653002 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-6d267f38-9f74-44e4-8694-d73b77fa5ec8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:29.660300 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d267f38-9f74-44e4-8694-d73b77fa5ec8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:29.660788 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d267f38-9f74-44e4-8694-d73b77fa5ec8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:29.661229 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d267f38-9f74-44e4-8694-d73b77fa5ec8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:29.661926 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d267f38-9f74-44e4-8694-d73b77fa5ec8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:29.662386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d267f38-9f74-44e4-8694-d73b77fa5ec8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:29.662820 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-6d267f38-9f74-44e4-8694-d73b77fa5ec8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:29.794045 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-6d267f38-9f74-44e4-8694-d73b77fa5ec8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:29.801943 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-6d267f38-9f74-44e4-8694-d73b77fa5ec8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1556 microversion: 2.1 time: 0.153387 Sep 09 21:39:29.802502 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 516/1012] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:29 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:29.823644 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-df41729c-1e10-41c1-be29-2fbaee8ca436 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:29.824144 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-df41729c-1e10-41c1-be29-2fbaee8ca436 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:29.830158 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df41729c-1e10-41c1-be29-2fbaee8ca436 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:29.830638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df41729c-1e10-41c1-be29-2fbaee8ca436 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:29.831073 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df41729c-1e10-41c1-be29-2fbaee8ca436 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:29.831783 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df41729c-1e10-41c1-be29-2fbaee8ca436 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:29.832757 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df41729c-1e10-41c1-be29-2fbaee8ca436 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:29.833180 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-df41729c-1e10-41c1-be29-2fbaee8ca436 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:29.910169 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-df41729c-1e10-41c1-be29-2fbaee8ca436 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090340 Sep 09 21:39:29.911038 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 497/1013] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 21:39:29 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:39:30.126343 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c3f707ca-f6dd-4486-9bbb-14399156882c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:30.127083 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c3f707ca-f6dd-4486-9bbb-14399156882c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:30.134477 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3f707ca-f6dd-4486-9bbb-14399156882c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:30.134965 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3f707ca-f6dd-4486-9bbb-14399156882c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:30.135397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3f707ca-f6dd-4486-9bbb-14399156882c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:30.136120 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3f707ca-f6dd-4486-9bbb-14399156882c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:30.136572 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3f707ca-f6dd-4486-9bbb-14399156882c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:30.136995 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c3f707ca-f6dd-4486-9bbb-14399156882c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:30.273238 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-c3f707ca-f6dd-4486-9bbb-14399156882c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:30.281397 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c3f707ca-f6dd-4486-9bbb-14399156882c tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1552 microversion: 2.1 time: 0.159008 Sep 09 21:39:30.281965 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 517/1014] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:30 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:39:31.305388 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-1d38e7d2-e8c3-4a8d-8c1c-dc4b8dcd031f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:31.305977 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-1d38e7d2-e8c3-4a8d-8c1c-dc4b8dcd031f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:31.312084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38e7d2-e8c3-4a8d-8c1c-dc4b8dcd031f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:31.312597 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38e7d2-e8c3-4a8d-8c1c-dc4b8dcd031f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:31.313054 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38e7d2-e8c3-4a8d-8c1c-dc4b8dcd031f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:31.313744 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38e7d2-e8c3-4a8d-8c1c-dc4b8dcd031f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:31.314215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38e7d2-e8c3-4a8d-8c1c-dc4b8dcd031f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:31.314776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-1d38e7d2-e8c3-4a8d-8c1c-dc4b8dcd031f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:31.393153 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-1d38e7d2-e8c3-4a8d-8c1c-dc4b8dcd031f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4654c5c4e09e4c25ab58aca20cfcc7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a4df4888bc427ab3f8195e68604c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:39:31.401550 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-1d38e7d2-e8c3-4a8d-8c1c-dc4b8dcd031f tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 200 len: 1510 microversion: 2.1 time: 0.100947 Sep 09 21:39:31.402112 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 498/1015] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:31 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 1510 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:39:31.459868 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-663604a4-e1ac-459a-a0a6-aad40a6a9b14 req-15d2803a-5d5b-4713-a30f-ee585614a7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83882853-8b42-46e9-9059-823457adff9a", "name": "network-vif-deleted", "tag": "3e813f66-d068-4e01-bb0e-c9e89d846726"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:31.472381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-663604a4-e1ac-459a-a0a6-aad40a6a9b14 req-15d2803a-5d5b-4713-a30f-ee585614a7d6 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:31.480450 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-663604a4-e1ac-459a-a0a6-aad40a6a9b14 req-15d2803a-5d5b-4713-a30f-ee585614a7d6 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:31.484660 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-663604a4-e1ac-459a-a0a6-aad40a6a9b14 req-15d2803a-5d5b-4713-a30f-ee585614a7d6 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:31.498816 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-663604a4-e1ac-459a-a0a6-aad40a6a9b14 req-15d2803a-5d5b-4713-a30f-ee585614a7d6 service nova] Creating event network-vif-deleted:3e813f66-d068-4e01-bb0e-c9e89d846726 for instance 83882853-8b42-46e9-9059-823457adff9a on hv-cinder-85221 Sep 09 21:39:31.505082 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-663604a4-e1ac-459a-a0a6-aad40a6a9b14 req-15d2803a-5d5b-4713-a30f-ee585614a7d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050486 Sep 09 21:39:31.505698 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 518/1016] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:39:32.425080 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:32.426227 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] [instance: 83882853-8b42-46e9-9059-823457adff9a] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:39:32.432641 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:32.433125 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:32.433558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:32.434244 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:32.434699 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:32.435119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:32.449672 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] HTTP exception thrown: Instance 83882853-8b42-46e9-9059-823457adff9a could not be found. Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Request method failure captured: Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a HTTP/1.1 Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7HNCus7d--i2KLcmqV8pGgJ863wuMoGZlNUvbvf-HXob_MBfXekWiLY0ZSb4QLj5mv7lTKpUXAo-zoBYOeBH0BHQEnb3NR94q-LZbgExVPJfdTga-IhLV0AoFBitHp1-MAaHUBB3A3_AYSbUdhJP_0SssvYISlv23VEtwhhc9LthUY Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 91a4df4888bc427ab3f8195e68604c96 Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-TestMinimumBasicScenario-544809831 Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:39:32.451336 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_91a4df4888bc427ab3f8195e68604c96", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/91a4df4888bc427ab3f8195e68604c96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/91a4df4888bc427ab3f8195e68604c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/91a4df4888bc427ab3f8195e68604c96"}]}] Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-TestMinimumBasicScenario-544809831 Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 91a4df4888bc427ab3f8195e68604c96 Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-TestMinimumBasicScenario-544809831 Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-TestMinimumBasicScenario-544809831-project Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 4654c5c4e09e4c25ab58aca20cfcc7e2 Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-TestMinimumBasicScenario-544809831-project Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 83882853-8b42-46e9-9059-823457adff9a could not be found. Sep 09 21:39:32.453233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '83882853-8b42-46e9-9059-823457adff9a'} Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83882853-8b42-46e9-9059-823457adff9a could not be found. Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:39:32.454166 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83882853-8b42-46e9-9059-823457adff9a could not be found. Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83882853-8b42-46e9-9059-823457adff9a could not be found. Sep 09 21:39:32.455835 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:39:32.457168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Returning 404 to user: Instance 83882853-8b42-46e9-9059-823457adff9a could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:39:32.457168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-e6289c70-4756-4109-be8b-b96cd124c135 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a" status: 404 len: 111 microversion: 2.1 time: 0.031728 Sep 09 21:39:32.457168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 499/1017] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:39:32 2022] GET /compute/v2.1/servers/83882853-8b42-46e9-9059-823457adff9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:39:32.463347 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a5a1a238-d6c2-4b60-8b43-cc60189bab09 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] Calling method '.version_select at 0x7f08130ac280>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:39:32.485113 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a5a1a238-d6c2-4b60-8b43-cc60189bab09 tempest-TestMinimumBasicScenario-544809831 tempest-TestMinimumBasicScenario-544809831-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-376666267" status: 202 len: 0 microversion: 2.1 time: 0.026159 Sep 09 21:39:32.485798 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 519/1018] 10.222.0.46 () {58 vars in 1269 bytes} [Fri Sep 9 21:39:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-376666267 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:39:33.521789 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-5e7dc2d5-9da4-46a6-a141-276a46f4eb24 req-0a9bd1e2-fb75-4e2e-88ef-c997b6f37222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ff12f3-8e9e-4811-b65a-0d1a1d15419f", "tag": "d2270997-af20-4f19-a9a2-0f55efd867c7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:39:33.531460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-5e7dc2d5-9da4-46a6-a141-276a46f4eb24 req-0a9bd1e2-fb75-4e2e-88ef-c997b6f37222 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:39:33.531977 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-5e7dc2d5-9da4-46a6-a141-276a46f4eb24 req-0a9bd1e2-fb75-4e2e-88ef-c997b6f37222 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:39:33.532656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-5e7dc2d5-9da4-46a6-a141-276a46f4eb24 req-0a9bd1e2-fb75-4e2e-88ef-c997b6f37222 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:39:33.544650 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-5e7dc2d5-9da4-46a6-a141-276a46f4eb24 req-0a9bd1e2-fb75-4e2e-88ef-c997b6f37222 service nova] Creating event network-changed:d2270997-af20-4f19-a9a2-0f55efd867c7 for instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f on hv-cinder-85221 Sep 09 21:39:33.549633 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-5e7dc2d5-9da4-46a6-a141-276a46f4eb24 req-0a9bd1e2-fb75-4e2e-88ef-c997b6f37222 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032460 Sep 09 21:39:33.550152 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 500/1019] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:40:36.229529 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:36.230264 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:36.234565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5e3dfb5c-8cc7-4034-9d3a-0a8a8cb54c84 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:36.235144 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5e3dfb5c-8cc7-4034-9d3a-0a8a8cb54c84 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:36.242494 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb5c-8cc7-4034-9d3a-0a8a8cb54c84 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:36.242983 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb5c-8cc7-4034-9d3a-0a8a8cb54c84 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:36.243413 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb5c-8cc7-4034-9d3a-0a8a8cb54c84 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:36.244737 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb5c-8cc7-4034-9d3a-0a8a8cb54c84 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:36.245187 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb5c-8cc7-4034-9d3a-0a8a8cb54c84 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:36.245607 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5e3dfb5c-8cc7-4034-9d3a-0a8a8cb54c84 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:36.270646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5e3dfb5c-8cc7-4034-9d3a-0a8a8cb54c84 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/ips" status: 200 len: 150 microversion: 2.1 time: 0.043542 Sep 09 21:40:36.271206 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 520/1020] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:40:36 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:40:37.604592 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:37.605433 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=32 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:37.610051 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-d4a4ac47-d0e6-4208-ba98-a16160ee697d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8297a6a-28e0-4640-b6af-63e1ced6381f"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:40:37.612454 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-d4a4ac47-d0e6-4208-ba98-a16160ee697d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:37.620703 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4a4ac47-d0e6-4208-ba98-a16160ee697d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:37.621191 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4a4ac47-d0e6-4208-ba98-a16160ee697d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:37.621633 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4a4ac47-d0e6-4208-ba98-a16160ee697d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:37.622323 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4a4ac47-d0e6-4208-ba98-a16160ee697d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:37.622781 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4a4ac47-d0e6-4208-ba98-a16160ee697d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:37.623210 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-d4a4ac47-d0e6-4208-ba98-a16160ee697d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:41.086753 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-d4a4ac47-d0e6-4208-ba98-a16160ee697d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.484056 Sep 09 21:40:41.087424 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 501/1021] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:40:37 2022] POST /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments => generated 194 bytes in 3486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:40:47.800811 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1816632143", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-225754611", "security_groups": [{"name": "tempest-secgroup-smoke-445796257"}], "block_device_mapping_v2": [{"uuid": "4c951ca5-85ce-4849-acb2-932bfd73012b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f0bd4c9c-2c7c-4b69-bda5-7da8485a7c26"}]}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:40:47.811849 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=4 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:47.812503 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=2 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:47.974648 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.network.neutron [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] validate_networks() for [('f0bd4c9c-2c7c-4b69-bda5-7da8485a7c26', None, None, None, None, None)] {{(pid=120465) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:40:48.445478 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Flavor limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:40:48.445907 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Image limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:40:48.446385 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Flavor pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:40:48.446798 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Image pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:40:48.447240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:40:48.459040 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:48.459525 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:48.459999 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:48.460729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:48.461194 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:48.461626 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:48.478764 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Getting quotas for project b9a36910972a4d87b508b918af36bbd5. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:40:48.483596 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Getting quotas for user 691a25c97f4748119366c35dd4688765 and project b9a36910972a4d87b508b918af36bbd5. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:40:48.540986 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Going to run 1 instances... {{(pid=120465) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:40:48.544315 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c951ca5-85ce-4849-acb2-932bfd73012b',volume_size=None,volume_type=None)] {{(pid=120465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:40:48.664545 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8297a6a-28e0-4640-b6af-63e1ced6381f"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:40:48.668243 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:48.676011 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:40:48.679095 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:48.679606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:48.680041 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:48.682149 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:48.683207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:48.683733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:48.693750 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c4917cc8-e815-48d8-ae43-ae0f61acaf37 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.896591 Sep 09 21:40:48.694509 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 521/1022] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:40:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:40:48.707164 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ce7823ac-d7ed-4810-9af5-efae5d9a7e7f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:48.708112 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ce7823ac-d7ed-4810-9af5-efae5d9a7e7f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:48.769708 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ce7823ac-d7ed-4810-9af5-efae5d9a7e7f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:48.776304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Invalid volume: volume e8297a6a-28e0-4640-b6af-63e1ced6381f is already attached to instances: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f Sep 09 21:40:48.777179 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ce7823ac-d7ed-4810-9af5-efae5d9a7e7f tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1094 microversion: 2.1 time: 0.074020 Sep 09 21:40:48.778019 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 522/1023] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:48 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: POST /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments HTTP/1.1 Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 74 Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:40:48.778716 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {"volumeAttachment": {"volumeId": "e8297a6a-28e0-4640-b6af-63e1ced6381f"}} Sep 09 21:40:48.780246 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Invalid volume: volume e8297a6a-28e0-4640-b6af-63e1ced6381f is already attached to instances: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'server_id': '07ff12f3-8e9e-4811-b65a-0d1a1d15419f', 'body': {'volumeAttachment': {'volumeId': 'e8297a6a-28e0-4640-b6af-63e1ced6381f'}}} Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e8297a6a-28e0-4640-b6af-63e1ced6381f is already attached to instances: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:40:48.781074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e8297a6a-28e0-4640-b6af-63e1ced6381f is already attached to instances: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:40:48.782443 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:40:48.783785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:40:48.783785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:40:48.783785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:40:48.783785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e8297a6a-28e0-4640-b6af-63e1ced6381f is already attached to instances: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f Sep 09 21:40:48.783785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:40:48.785561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 400 to user: Invalid volume: volume e8297a6a-28e0-4640-b6af-63e1ced6381f is already attached to instances: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:40:48.786595 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4bfd57b2-5f18-4591-a1b1-0cc985df353b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126437 Sep 09 21:40:48.787619 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 502/1024] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:40:48 2022] POST /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments => generated 174 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:40:48.857055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-3e233eba-e0e0-42ca-9c2f-53080f8d455d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:48.857571 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-3e233eba-e0e0-42ca-9c2f-53080f8d455d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:48.864113 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e233eba-e0e0-42ca-9c2f-53080f8d455d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:48.864600 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e233eba-e0e0-42ca-9c2f-53080f8d455d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:48.865038 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e233eba-e0e0-42ca-9c2f-53080f8d455d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:48.865733 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e233eba-e0e0-42ca-9c2f-53080f8d455d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:48.866191 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e233eba-e0e0-42ca-9c2f-53080f8d455d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:48.866619 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-3e233eba-e0e0-42ca-9c2f-53080f8d455d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:48.950699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-3e233eba-e0e0-42ca-9c2f-53080f8d455d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lazy-loading 'services' on Instance uuid 07ff12f3-8e9e-4811-b65a-0d1a1d15419f {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:40:49.026963 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-3e233eba-e0e0-42ca-9c2f-53080f8d455d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments/e8297a6a-28e0-4640-b6af-63e1ced6381f" status: 202 len: 0 microversion: 2.1 time: 0.173968 Sep 09 21:40:49.027589 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 523/1025] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:40:48 2022] DELETE /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments/e8297a6a-28e0-4640-b6af-63e1ced6381f => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:40:49.035899 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-759d4b3c-6a21-4fe7-b5dc-6bf057a125b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:49.038308 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-759d4b3c-6a21-4fe7-b5dc-6bf057a125b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:49.045320 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-759d4b3c-6a21-4fe7-b5dc-6bf057a125b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:49.045817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-759d4b3c-6a21-4fe7-b5dc-6bf057a125b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:49.046255 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-759d4b3c-6a21-4fe7-b5dc-6bf057a125b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:49.047052 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-759d4b3c-6a21-4fe7-b5dc-6bf057a125b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:49.047514 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-759d4b3c-6a21-4fe7-b5dc-6bf057a125b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:49.047991 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-759d4b3c-6a21-4fe7-b5dc-6bf057a125b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:49.082016 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-759d4b3c-6a21-4fe7-b5dc-6bf057a125b3 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049954 Sep 09 21:40:49.082703 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 503/1026] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:40:49 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:40:49.801658 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-856885d3-c5c1-4ee4-9769-93ebe1344c05 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:49.802454 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-856885d3-c5c1-4ee4-9769-93ebe1344c05 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:49.808580 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-856885d3-c5c1-4ee4-9769-93ebe1344c05 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:49.809062 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-856885d3-c5c1-4ee4-9769-93ebe1344c05 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:49.809498 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-856885d3-c5c1-4ee4-9769-93ebe1344c05 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:49.810210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-856885d3-c5c1-4ee4-9769-93ebe1344c05 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:49.810670 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-856885d3-c5c1-4ee4-9769-93ebe1344c05 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:49.811135 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-856885d3-c5c1-4ee4-9769-93ebe1344c05 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:49.875392 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-856885d3-c5c1-4ee4-9769-93ebe1344c05 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:49.883291 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-856885d3-c5c1-4ee4-9769-93ebe1344c05 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1192 microversion: 2.1 time: 0.085818 Sep 09 21:40:49.883881 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 524/1027] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:49 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:40:50.095453 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-4e6d2d60-d64b-488e-a9c2-f291ce3b33f1 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:50.097622 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-4e6d2d60-d64b-488e-a9c2-f291ce3b33f1 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:50.104344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e6d2d60-d64b-488e-a9c2-f291ce3b33f1 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:50.104840 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e6d2d60-d64b-488e-a9c2-f291ce3b33f1 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:50.105284 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e6d2d60-d64b-488e-a9c2-f291ce3b33f1 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:50.105983 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e6d2d60-d64b-488e-a9c2-f291ce3b33f1 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:50.106440 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e6d2d60-d64b-488e-a9c2-f291ce3b33f1 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:50.106871 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-4e6d2d60-d64b-488e-a9c2-f291ce3b33f1 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:50.136385 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-4e6d2d60-d64b-488e-a9c2-f291ce3b33f1 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044415 Sep 09 21:40:50.137137 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 504/1028] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:40:50 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:40:50.206921 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7734bffb-a9e7-4ee7-a804-d028ffa81246 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:50.207586 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7734bffb-a9e7-4ee7-a804-d028ffa81246 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:50.214654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7734bffb-a9e7-4ee7-a804-d028ffa81246 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:50.215324 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7734bffb-a9e7-4ee7-a804-d028ffa81246 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:50.215931 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7734bffb-a9e7-4ee7-a804-d028ffa81246 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:50.216851 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7734bffb-a9e7-4ee7-a804-d028ffa81246 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:50.217314 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7734bffb-a9e7-4ee7-a804-d028ffa81246 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:50.217908 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7734bffb-a9e7-4ee7-a804-d028ffa81246 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:50.248278 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7734bffb-a9e7-4ee7-a804-d028ffa81246 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:40:50.335034 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7734bffb-a9e7-4ee7-a804-d028ffa81246 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 204 len: 0 microversion: 2.1 time: 0.132075 Sep 09 21:40:50.336028 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 525/1029] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:40:50 2022] DELETE /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:40:50.344723 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-57d4156c-03f4-46c0-a206-840b25d941a2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:50.345339 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-57d4156c-03f4-46c0-a206-840b25d941a2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:50.352264 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57d4156c-03f4-46c0-a206-840b25d941a2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:50.352766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57d4156c-03f4-46c0-a206-840b25d941a2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:50.353195 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57d4156c-03f4-46c0-a206-840b25d941a2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:50.353891 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57d4156c-03f4-46c0-a206-840b25d941a2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:50.355258 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57d4156c-03f4-46c0-a206-840b25d941a2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:50.355743 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-57d4156c-03f4-46c0-a206-840b25d941a2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:50.533949 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-57d4156c-03f4-46c0-a206-840b25d941a2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:50.542032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-57d4156c-03f4-46c0-a206-840b25d941a2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1680 microversion: 2.1 time: 0.201659 Sep 09 21:40:50.542889 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 505/1030] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:50 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:40:50.907338 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-83c79913-1c1e-434b-b633-304dc217861b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:50.908080 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-83c79913-1c1e-434b-b633-304dc217861b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:50.915119 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83c79913-1c1e-434b-b633-304dc217861b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:50.915882 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83c79913-1c1e-434b-b633-304dc217861b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:50.917601 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83c79913-1c1e-434b-b633-304dc217861b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:50.918340 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83c79913-1c1e-434b-b633-304dc217861b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:50.918791 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83c79913-1c1e-434b-b633-304dc217861b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:50.919447 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-83c79913-1c1e-434b-b633-304dc217861b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:51.070621 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-83c79913-1c1e-434b-b633-304dc217861b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:51.079182 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-83c79913-1c1e-434b-b633-304dc217861b tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1277 microversion: 2.1 time: 0.176001 Sep 09 21:40:51.079785 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 526/1031] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:50 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:40:51.670830 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-250b5f21-ce50-4dc5-92b1-0fd6a15f13c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:51.671768 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-250b5f21-ce50-4dc5-92b1-0fd6a15f13c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:51.679459 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-250b5f21-ce50-4dc5-92b1-0fd6a15f13c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:51.680109 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-250b5f21-ce50-4dc5-92b1-0fd6a15f13c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:51.680710 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-250b5f21-ce50-4dc5-92b1-0fd6a15f13c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:51.684422 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-250b5f21-ce50-4dc5-92b1-0fd6a15f13c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:51.684978 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-250b5f21-ce50-4dc5-92b1-0fd6a15f13c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:51.685493 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-250b5f21-ce50-4dc5-92b1-0fd6a15f13c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:51.940219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-250b5f21-ce50-4dc5-92b1-0fd6a15f13c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:51.947840 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-250b5f21-ce50-4dc5-92b1-0fd6a15f13c5 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1680 microversion: 2.1 time: 0.385875 Sep 09 21:40:51.948410 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 506/1032] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:51 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1680 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:40:52.102405 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b07548d7-7821-48f2-a694-1bc1023f6270 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:52.103019 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b07548d7-7821-48f2-a694-1bc1023f6270 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:52.111116 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b07548d7-7821-48f2-a694-1bc1023f6270 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:52.111911 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b07548d7-7821-48f2-a694-1bc1023f6270 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:52.112387 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b07548d7-7821-48f2-a694-1bc1023f6270 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:52.113036 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b07548d7-7821-48f2-a694-1bc1023f6270 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:52.113495 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b07548d7-7821-48f2-a694-1bc1023f6270 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:52.113920 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b07548d7-7821-48f2-a694-1bc1023f6270 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:52.256941 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b07548d7-7821-48f2-a694-1bc1023f6270 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:52.264713 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b07548d7-7821-48f2-a694-1bc1023f6270 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.166304 Sep 09 21:40:52.265286 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 527/1033] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:52 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:40:52.420670 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-121efe75-5a00-4bac-bf03-9200cb6666c1 req-737c58b4-781e-485c-be6c-97c56b263ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff789631-8cfd-4414-aba7-d8cffbcffe32", "tag": "5c4e35f0-ebe2-4f02-a6e9-49793cd6fab7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:40:52.430779 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-121efe75-5a00-4bac-bf03-9200cb6666c1 req-737c58b4-781e-485c-be6c-97c56b263ff3 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:52.431339 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-121efe75-5a00-4bac-bf03-9200cb6666c1 req-737c58b4-781e-485c-be6c-97c56b263ff3 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:52.431866 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-121efe75-5a00-4bac-bf03-9200cb6666c1 req-737c58b4-781e-485c-be6c-97c56b263ff3 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:52.444816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-121efe75-5a00-4bac-bf03-9200cb6666c1 req-737c58b4-781e-485c-be6c-97c56b263ff3 service nova] Creating event network-changed:5c4e35f0-ebe2-4f02-a6e9-49793cd6fab7 for instance ff789631-8cfd-4414-aba7-d8cffbcffe32 on hv-cinder-85221 Sep 09 21:40:52.452981 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-121efe75-5a00-4bac-bf03-9200cb6666c1 req-737c58b4-781e-485c-be6c-97c56b263ff3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037168 Sep 09 21:40:52.454321 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 507/1034] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:40:52.970599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-81fba8fb-4308-4e86-a6fb-7a52e63c4437 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:52.971222 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-81fba8fb-4308-4e86-a6fb-7a52e63c4437 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:52.977282 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81fba8fb-4308-4e86-a6fb-7a52e63c4437 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:52.977782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81fba8fb-4308-4e86-a6fb-7a52e63c4437 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:52.978224 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81fba8fb-4308-4e86-a6fb-7a52e63c4437 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:52.978926 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81fba8fb-4308-4e86-a6fb-7a52e63c4437 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:52.979488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81fba8fb-4308-4e86-a6fb-7a52e63c4437 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:52.979936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-81fba8fb-4308-4e86-a6fb-7a52e63c4437 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:53.046528 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-81fba8fb-4308-4e86-a6fb-7a52e63c4437 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:53.054988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-81fba8fb-4308-4e86-a6fb-7a52e63c4437 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1613 microversion: 2.1 time: 0.088267 Sep 09 21:40:53.055663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 528/1035] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:52 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:40:53.288135 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6752c6b2-3771-4ede-be1f-957fdfa19c07 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:53.288886 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6752c6b2-3771-4ede-be1f-957fdfa19c07 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:53.295973 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6752c6b2-3771-4ede-be1f-957fdfa19c07 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:53.296462 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6752c6b2-3771-4ede-be1f-957fdfa19c07 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:53.296895 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6752c6b2-3771-4ede-be1f-957fdfa19c07 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:53.297755 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6752c6b2-3771-4ede-be1f-957fdfa19c07 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:53.298215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6752c6b2-3771-4ede-be1f-957fdfa19c07 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:53.298639 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6752c6b2-3771-4ede-be1f-957fdfa19c07 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:53.439159 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-6752c6b2-3771-4ede-be1f-957fdfa19c07 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:53.447598 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6752c6b2-3771-4ede-be1f-957fdfa19c07 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.163697 Sep 09 21:40:53.456488 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 508/1036] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:53 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:40:54.079169 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:54.079956 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:54.087724 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:54.088146 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:54.089217 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:54.090259 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:54.090726 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:54.091157 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:54.124054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:54.124816 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:54.125255 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:54.125708 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lazy-loading 'fault' on Instance uuid 07ff12f3-8e9e-4811-b65a-0d1a1d15419f {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:40:54.169792 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:54.177495 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a4e1d221-7466-4f3c-a4fa-a4c71f8fbac2 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 200 len: 1330 microversion: 2.1 time: 0.102274 Sep 09 21:40:54.178049 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 529/1037] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:54 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:40:54.467890 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-48a116c4-e0f7-4cda-b073-9f87981d2846 req-38074a78-7c4a-44a8-8401-8ae299fd2156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ff12f3-8e9e-4811-b65a-0d1a1d15419f", "name": "network-vif-deleted", "tag": "d2270997-af20-4f19-a9a2-0f55efd867c7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:40:54.470881 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2baf4b58-cfdb-426f-85d3-12608f85a96c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:54.471490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2baf4b58-cfdb-426f-85d3-12608f85a96c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:54.477388 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2baf4b58-cfdb-426f-85d3-12608f85a96c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:54.477734 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-48a116c4-e0f7-4cda-b073-9f87981d2846 req-38074a78-7c4a-44a8-8401-8ae299fd2156 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:54.477861 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2baf4b58-cfdb-426f-85d3-12608f85a96c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:54.478215 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-48a116c4-e0f7-4cda-b073-9f87981d2846 req-38074a78-7c4a-44a8-8401-8ae299fd2156 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:54.478450 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2baf4b58-cfdb-426f-85d3-12608f85a96c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:54.478649 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-48a116c4-e0f7-4cda-b073-9f87981d2846 req-38074a78-7c4a-44a8-8401-8ae299fd2156 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:54.478953 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2baf4b58-cfdb-426f-85d3-12608f85a96c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:54.479641 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2baf4b58-cfdb-426f-85d3-12608f85a96c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:54.480254 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2baf4b58-cfdb-426f-85d3-12608f85a96c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:54.489560 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-48a116c4-e0f7-4cda-b073-9f87981d2846 req-38074a78-7c4a-44a8-8401-8ae299fd2156 service nova] Creating event network-vif-deleted:d2270997-af20-4f19-a9a2-0f55efd867c7 for instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f on hv-cinder-85221 Sep 09 21:40:54.494274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-48a116c4-e0f7-4cda-b073-9f87981d2846 req-38074a78-7c4a-44a8-8401-8ae299fd2156 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030292 Sep 09 21:40:54.495574 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 509/1038] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:40:54.622493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2baf4b58-cfdb-426f-85d3-12608f85a96c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:54.630170 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2baf4b58-cfdb-426f-85d3-12608f85a96c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.163066 Sep 09 21:40:54.630732 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 530/1039] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:54 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:40:55.201360 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:55.202072 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:55.208817 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:55.209610 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:55.210047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:55.210727 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:55.211183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:55.211637 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:55.225503 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f HTTP/1.1 Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:40:55.227763 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:40:55.230084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '07ff12f3-8e9e-4811-b65a-0d1a1d15419f'} Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:40:55.231285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:40:55.232807 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:40:55.234219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:40:55.234219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-cd0d94ae-e3c6-482b-9445-5a1015725c97 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 404 len: 111 microversion: 2.1 time: 0.032578 Sep 09 21:40:55.234219 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 510/1040] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:55 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:40:55.239409 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-32a70a68-ec2f-4525-a07e-706c2a23fabc tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '.version_select at 0x7f08130d8af0>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:55.258295 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-32a70a68-ec2f-4525-a07e-706c2a23fabc tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-958892321" status: 202 len: 0 microversion: 2.1 time: 0.022761 Sep 09 21:40:55.258837 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 531/1041] 10.222.0.46 () {58 vars in 1218 bytes} [Fri Sep 9 21:40:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-958892321 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:40:55.654390 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-7d922e58-768d-4327-867b-89a72abf31e7 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:55.655047 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-7d922e58-768d-4327-867b-89a72abf31e7 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:55.662089 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d922e58-768d-4327-867b-89a72abf31e7 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:55.662582 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d922e58-768d-4327-867b-89a72abf31e7 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:55.663023 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d922e58-768d-4327-867b-89a72abf31e7 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:55.663764 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d922e58-768d-4327-867b-89a72abf31e7 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:55.664225 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d922e58-768d-4327-867b-89a72abf31e7 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:55.665020 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-7d922e58-768d-4327-867b-89a72abf31e7 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:55.801145 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-7d922e58-768d-4327-867b-89a72abf31e7 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:55.809903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-7d922e58-768d-4327-867b-89a72abf31e7 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.160473 Sep 09 21:40:55.814743 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 511/1042] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:55 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:40:56.132190 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-03c0cb65-daac-44de-a77e-7adeabc1a956 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: .version_select at 0x7f081333e280>, body: {"keypair": {"name": "tempest-keypair-1781050286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9Xik7g4s3ExJVl2YYmWVPj+qie60Mk2HX94MvPIfjbLI8US3pIv4TRPcr7KiacqP6veQBuJuERHEtDwqxjbi65t7e+pX6vG7BHx31XVFEMFRkUvXWd1nzsSKOd5FnUvQ=="}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:40:56.148711 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-03c0cb65-daac-44de-a77e-7adeabc1a956 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for project 7cca63adb761474d82636997dade783a. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:40:56.152474 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-03c0cb65-daac-44de-a77e-7adeabc1a956 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for user 70dcf397dc04470b9756119a9fe8f6a6 and project 7cca63adb761474d82636997dade783a. Resources: {'key_pairs'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:40:56.174118 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-03c0cb65-daac-44de-a77e-7adeabc1a956 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045876 Sep 09 21:40:56.174699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 532/1043] 10.222.0.46 () {60 vars in 1159 bytes} [Fri Sep 9 21:40:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:40:56.834187 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-22e29449-e0b5-4e60-8426-fff2d1d4eabb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:56.835664 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-22e29449-e0b5-4e60-8426-fff2d1d4eabb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:56.842912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22e29449-e0b5-4e60-8426-fff2d1d4eabb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:56.843409 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22e29449-e0b5-4e60-8426-fff2d1d4eabb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:56.843882 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22e29449-e0b5-4e60-8426-fff2d1d4eabb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:56.844589 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22e29449-e0b5-4e60-8426-fff2d1d4eabb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:56.845055 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22e29449-e0b5-4e60-8426-fff2d1d4eabb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:56.845486 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-22e29449-e0b5-4e60-8426-fff2d1d4eabb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:56.991431 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-22e29449-e0b5-4e60-8426-fff2d1d4eabb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:56.999765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-22e29449-e0b5-4e60-8426-fff2d1d4eabb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.169420 Sep 09 21:40:57.000331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 512/1044] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:56 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:40:57.389779 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-557287702", "imageRef": "0943f8c9-4508-4735-93fe-ca244054aca0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8b93671-3117-4194-8e44-7e685c00fc4d"}], "security_groups": [{"name": "tempest-securitygroup--1625090239"}], "key_name": "tempest-keypair-1781050286", "user_data": "}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:40:57.495266 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.network.neutron [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] validate_networks() for [('b8b93671-3117-4194-8e44-7e685c00fc4d', None, None, None, None, None)] {{(pid=120465) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:40:57.864183 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Flavor limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:40:57.864601 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Image limits 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:40:57.865069 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Flavor pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:40:57.865472 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Image pref 0:0:0 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:40:57.865876 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.virt.hardware [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:40:57.875114 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:57.875615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:57.876048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:57.876760 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:57.877211 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:57.877630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:57.893574 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for project 7cca63adb761474d82636997dade783a. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:40:57.897427 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.quota [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Getting quotas for user 70dcf397dc04470b9756119a9fe8f6a6 and project 7cca63adb761474d82636997dade783a. Resources: {'ram', 'instances', 'cores'} {{(pid=120465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:40:57.908409 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Going to run 1 instances... {{(pid=120465) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:40:57.910635 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0943f8c9-4508-4735-93fe-ca244054aca0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:40:57.959272 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a4435ebb-50ee-494d-8ef9-5c268f7f69f6 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.574172 Sep 09 21:40:57.960292 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 533/1045] 10.222.0.46 () {60 vars in 1147 bytes} [Fri Sep 9 21:40:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:40:57.972084 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-75bccdaa-ba4f-4295-9d25-d0a8b16bce05 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:57.972699 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-75bccdaa-ba4f-4295-9d25-d0a8b16bce05 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:58.022500 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-830842e6-7201-47ae-8cd1-5c6349fe1287 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:58.023148 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-830842e6-7201-47ae-8cd1-5c6349fe1287 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:58.030628 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-830842e6-7201-47ae-8cd1-5c6349fe1287 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:58.031184 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-830842e6-7201-47ae-8cd1-5c6349fe1287 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:58.031664 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-830842e6-7201-47ae-8cd1-5c6349fe1287 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:58.032379 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-830842e6-7201-47ae-8cd1-5c6349fe1287 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:58.032839 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-830842e6-7201-47ae-8cd1-5c6349fe1287 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:58.033271 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-830842e6-7201-47ae-8cd1-5c6349fe1287 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:58.197527 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-830842e6-7201-47ae-8cd1-5c6349fe1287 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:58.206878 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-830842e6-7201-47ae-8cd1-5c6349fe1287 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.188363 Sep 09 21:40:58.207668 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 534/1046] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:58 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:40:58.289267 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-75bccdaa-ba4f-4295-9d25-d0a8b16bce05 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:58.297454 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-75bccdaa-ba4f-4295-9d25-d0a8b16bce05 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1241 microversion: 2.1 time: 0.329203 Sep 09 21:40:58.298021 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 513/1047] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:57 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1241 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:40:59.230802 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e183000b-6d8a-45ed-8077-bd1c9108ece8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:59.231414 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-e183000b-6d8a-45ed-8077-bd1c9108ece8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:59.237855 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e183000b-6d8a-45ed-8077-bd1c9108ece8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:59.238338 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e183000b-6d8a-45ed-8077-bd1c9108ece8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:59.238780 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e183000b-6d8a-45ed-8077-bd1c9108ece8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:59.239464 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e183000b-6d8a-45ed-8077-bd1c9108ece8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:59.239952 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e183000b-6d8a-45ed-8077-bd1c9108ece8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:59.240377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-e183000b-6d8a-45ed-8077-bd1c9108ece8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:59.320157 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-bac2cabd-c8c7-4e89-9804-b7401cdcce2d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:40:59.320814 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-bac2cabd-c8c7-4e89-9804-b7401cdcce2d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:40:59.328028 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bac2cabd-c8c7-4e89-9804-b7401cdcce2d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:59.328519 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bac2cabd-c8c7-4e89-9804-b7401cdcce2d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:59.328957 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bac2cabd-c8c7-4e89-9804-b7401cdcce2d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:59.329648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bac2cabd-c8c7-4e89-9804-b7401cdcce2d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:40:59.330108 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bac2cabd-c8c7-4e89-9804-b7401cdcce2d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:40:59.330539 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-bac2cabd-c8c7-4e89-9804-b7401cdcce2d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:40:59.372186 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-e183000b-6d8a-45ed-8077-bd1c9108ece8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:59.379829 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e183000b-6d8a-45ed-8077-bd1c9108ece8 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.153372 Sep 09 21:40:59.380479 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 535/1048] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:59 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:40:59.393444 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-bac2cabd-c8c7-4e89-9804-b7401cdcce2d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:40:59.401747 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-bac2cabd-c8c7-4e89-9804-b7401cdcce2d tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1293 microversion: 2.1 time: 0.084837 Sep 09 21:40:59.402310 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 514/1049] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:40:59 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:41:00.403816 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8797a4f2-5567-40e4-945d-17e304711750 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:00.404458 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8797a4f2-5567-40e4-945d-17e304711750 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:00.411392 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8797a4f2-5567-40e4-945d-17e304711750 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:00.411924 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8797a4f2-5567-40e4-945d-17e304711750 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:00.412363 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8797a4f2-5567-40e4-945d-17e304711750 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:00.413071 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8797a4f2-5567-40e4-945d-17e304711750 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:00.413536 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8797a4f2-5567-40e4-945d-17e304711750 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:00.413961 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8797a4f2-5567-40e4-945d-17e304711750 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:00.424746 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ccd52837-a231-45db-8f5d-ed2cb1a2b3ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:00.425531 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ccd52837-a231-45db-8f5d-ed2cb1a2b3ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:00.433207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ccd52837-a231-45db-8f5d-ed2cb1a2b3ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:00.433706 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ccd52837-a231-45db-8f5d-ed2cb1a2b3ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:00.434154 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ccd52837-a231-45db-8f5d-ed2cb1a2b3ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:00.434882 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ccd52837-a231-45db-8f5d-ed2cb1a2b3ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:00.435383 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ccd52837-a231-45db-8f5d-ed2cb1a2b3ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:00.435848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ccd52837-a231-45db-8f5d-ed2cb1a2b3ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:00.538410 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-ccd52837-a231-45db-8f5d-ed2cb1a2b3ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:00.549594 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ccd52837-a231-45db-8f5d-ed2cb1a2b3ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1299 microversion: 2.1 time: 0.128743 Sep 09 21:41:00.551056 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 515/1050] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:00 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:41:00.590239 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8797a4f2-5567-40e4-945d-17e304711750 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:00.598014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8797a4f2-5567-40e4-945d-17e304711750 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.198744 Sep 09 21:41:00.598604 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 536/1051] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:00 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:41:01.574429 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-720c5cfe-5227-4557-a092-3bd897a08207 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:01.575202 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-720c5cfe-5227-4557-a092-3bd897a08207 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:01.581974 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-720c5cfe-5227-4557-a092-3bd897a08207 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:01.582481 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-720c5cfe-5227-4557-a092-3bd897a08207 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:01.583060 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-720c5cfe-5227-4557-a092-3bd897a08207 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:01.583815 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-720c5cfe-5227-4557-a092-3bd897a08207 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:01.584285 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-720c5cfe-5227-4557-a092-3bd897a08207 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:01.584725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-720c5cfe-5227-4557-a092-3bd897a08207 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:01.621071 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-603e1118-0b8c-40b3-aea1-3e166c217bf1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:01.621794 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-603e1118-0b8c-40b3-aea1-3e166c217bf1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:01.628640 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-603e1118-0b8c-40b3-aea1-3e166c217bf1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:01.629124 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-603e1118-0b8c-40b3-aea1-3e166c217bf1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:01.629566 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-603e1118-0b8c-40b3-aea1-3e166c217bf1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:01.630445 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-603e1118-0b8c-40b3-aea1-3e166c217bf1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:01.630991 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-603e1118-0b8c-40b3-aea1-3e166c217bf1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:01.631951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-603e1118-0b8c-40b3-aea1-3e166c217bf1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:01.768928 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-603e1118-0b8c-40b3-aea1-3e166c217bf1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:01.769521 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-720c5cfe-5227-4557-a092-3bd897a08207 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:01.777335 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-603e1118-0b8c-40b3-aea1-3e166c217bf1 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.160065 Sep 09 21:41:01.778175 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-720c5cfe-5227-4557-a092-3bd897a08207 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1367 microversion: 2.1 time: 0.208296 Sep 09 21:41:01.778754 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 516/1052] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:01 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:41:01.781893 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 537/1053] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:01 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:41:01.871688 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-27a8721c-1c30-43c8-933a-c685fd081a58 req-47a5f58f-b0fd-48ba-a9e9-acb674b8250f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48da7195-9699-404f-b9a9-f183ac3d42db", "tag": "c5c09938-e4db-4532-b8c8-2c5de5880e73"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:41:01.881274 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-27a8721c-1c30-43c8-933a-c685fd081a58 req-47a5f58f-b0fd-48ba-a9e9-acb674b8250f service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:01.881771 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-27a8721c-1c30-43c8-933a-c685fd081a58 req-47a5f58f-b0fd-48ba-a9e9-acb674b8250f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:01.882209 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-27a8721c-1c30-43c8-933a-c685fd081a58 req-47a5f58f-b0fd-48ba-a9e9-acb674b8250f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:01.895189 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-27a8721c-1c30-43c8-933a-c685fd081a58 req-47a5f58f-b0fd-48ba-a9e9-acb674b8250f service nova] Creating event network-changed:c5c09938-e4db-4532-b8c8-2c5de5880e73 for instance 48da7195-9699-404f-b9a9-f183ac3d42db on hv-cinder-85221 Sep 09 21:41:01.902806 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-27a8721c-1c30-43c8-933a-c685fd081a58 req-47a5f58f-b0fd-48ba-a9e9-acb674b8250f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035933 Sep 09 21:41:01.903515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 517/1054] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:41:02.227365 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-6fc1db68-99c4-47cc-8ec9-6dd99cc86d73 req-32048669-3be0-4a44-a53f-5d3d55091771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff789631-8cfd-4414-aba7-d8cffbcffe32", "name": "network-vif-plugged", "status": "completed", "tag": "5c4e35f0-ebe2-4f02-a6e9-49793cd6fab7"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:41:02.240091 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-6fc1db68-99c4-47cc-8ec9-6dd99cc86d73 req-32048669-3be0-4a44-a53f-5d3d55091771 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:02.240854 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-6fc1db68-99c4-47cc-8ec9-6dd99cc86d73 req-32048669-3be0-4a44-a53f-5d3d55091771 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:02.241504 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-6fc1db68-99c4-47cc-8ec9-6dd99cc86d73 req-32048669-3be0-4a44-a53f-5d3d55091771 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:02.252999 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-6fc1db68-99c4-47cc-8ec9-6dd99cc86d73 req-32048669-3be0-4a44-a53f-5d3d55091771 service nova] Creating event network-vif-plugged:5c4e35f0-ebe2-4f02-a6e9-49793cd6fab7 for instance ff789631-8cfd-4414-aba7-d8cffbcffe32 on hv-cinder-85221 Sep 09 21:41:02.258315 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-6fc1db68-99c4-47cc-8ec9-6dd99cc86d73 req-32048669-3be0-4a44-a53f-5d3d55091771 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035315 Sep 09 21:41:02.259055 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 538/1055] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:41:02.800224 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-98273551-a455-483a-9d90-48953d46ed1c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:02.800914 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-98273551-a455-483a-9d90-48953d46ed1c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:02.808203 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98273551-a455-483a-9d90-48953d46ed1c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:02.808872 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98273551-a455-483a-9d90-48953d46ed1c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:02.809258 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98273551-a455-483a-9d90-48953d46ed1c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:02.809945 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98273551-a455-483a-9d90-48953d46ed1c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:02.810398 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98273551-a455-483a-9d90-48953d46ed1c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:02.810821 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-98273551-a455-483a-9d90-48953d46ed1c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:02.812179 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-024379a1-2613-4339-a11c-4834608ed78e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:02.812873 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-024379a1-2613-4339-a11c-4834608ed78e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:02.819510 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-024379a1-2613-4339-a11c-4834608ed78e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:02.820066 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-024379a1-2613-4339-a11c-4834608ed78e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:02.820534 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-024379a1-2613-4339-a11c-4834608ed78e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:02.821287 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-024379a1-2613-4339-a11c-4834608ed78e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:02.821742 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-024379a1-2613-4339-a11c-4834608ed78e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:02.822167 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-024379a1-2613-4339-a11c-4834608ed78e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:02.950207 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-98273551-a455-483a-9d90-48953d46ed1c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:02.951078 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-024379a1-2613-4339-a11c-4834608ed78e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:02.954682 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:02.958213 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-98273551-a455-483a-9d90-48953d46ed1c tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.162262 Sep 09 21:41:02.959086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 518/1056] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:02 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:41:02.959442 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-024379a1-2613-4339-a11c-4834608ed78e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1367 microversion: 2.1 time: 0.151887 Sep 09 21:41:02.960099 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 539/1057] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:02 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:41:03.982218 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c93266c4-2e77-4ef7-8d66-4d0a90c696bb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:03.982797 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4ba6e96d-af02-4369-ab2d-b4414a7cf0cd tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:03.983186 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c93266c4-2e77-4ef7-8d66-4d0a90c696bb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:03.983302 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4ba6e96d-af02-4369-ab2d-b4414a7cf0cd tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:03.989750 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c93266c4-2e77-4ef7-8d66-4d0a90c696bb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:03.990126 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4ba6e96d-af02-4369-ab2d-b4414a7cf0cd tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:03.990258 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c93266c4-2e77-4ef7-8d66-4d0a90c696bb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:03.990623 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4ba6e96d-af02-4369-ab2d-b4414a7cf0cd tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:03.990734 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c93266c4-2e77-4ef7-8d66-4d0a90c696bb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:03.991062 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4ba6e96d-af02-4369-ab2d-b4414a7cf0cd tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:03.991358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c93266c4-2e77-4ef7-8d66-4d0a90c696bb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:03.991787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4ba6e96d-af02-4369-ab2d-b4414a7cf0cd tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:03.991898 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c93266c4-2e77-4ef7-8d66-4d0a90c696bb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:03.992250 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4ba6e96d-af02-4369-ab2d-b4414a7cf0cd tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:03.992374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c93266c4-2e77-4ef7-8d66-4d0a90c696bb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:03.992686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4ba6e96d-af02-4369-ab2d-b4414a7cf0cd tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:04.126433 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-4ba6e96d-af02-4369-ab2d-b4414a7cf0cd tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:04.130670 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c93266c4-2e77-4ef7-8d66-4d0a90c696bb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:04.134270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4ba6e96d-af02-4369-ab2d-b4414a7cf0cd tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1367 microversion: 2.1 time: 0.155747 Sep 09 21:41:04.134460 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:04.135066 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 540/1058] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:03 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:41:04.140437 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c93266c4-2e77-4ef7-8d66-4d0a90c696bb tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.162501 Sep 09 21:41:04.141071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 519/1059] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:03 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:41:05.158279 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-1527e311-cf3c-4187-9ced-01535bccea9e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:05.158840 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-1527e311-cf3c-4187-9ced-01535bccea9e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:05.162541 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-25070c18-99db-425f-9afd-6423b4c9506d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:05.163154 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-25070c18-99db-425f-9afd-6423b4c9506d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:05.165890 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1527e311-cf3c-4187-9ced-01535bccea9e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:05.166385 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1527e311-cf3c-4187-9ced-01535bccea9e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:05.167117 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1527e311-cf3c-4187-9ced-01535bccea9e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:05.168323 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1527e311-cf3c-4187-9ced-01535bccea9e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:05.168853 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1527e311-cf3c-4187-9ced-01535bccea9e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:05.169352 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-1527e311-cf3c-4187-9ced-01535bccea9e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:05.170999 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25070c18-99db-425f-9afd-6423b4c9506d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:05.171492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25070c18-99db-425f-9afd-6423b4c9506d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:05.171969 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25070c18-99db-425f-9afd-6423b4c9506d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:05.172659 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25070c18-99db-425f-9afd-6423b4c9506d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:05.173122 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25070c18-99db-425f-9afd-6423b4c9506d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:05.173553 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-25070c18-99db-425f-9afd-6423b4c9506d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:05.305377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-1527e311-cf3c-4187-9ced-01535bccea9e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:05.313770 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-1527e311-cf3c-4187-9ced-01535bccea9e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1367 microversion: 2.1 time: 0.159314 Sep 09 21:41:05.314565 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 541/1060] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:05 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:41:05.370504 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-25070c18-99db-425f-9afd-6423b4c9506d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:05.378165 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-25070c18-99db-425f-9afd-6423b4c9506d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.220092 Sep 09 21:41:05.378722 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 520/1061] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:05 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:41:06.336386 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-5b2d4037-d8df-43aa-9e86-85e51e736c73 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:06.337034 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-5b2d4037-d8df-43aa-9e86-85e51e736c73 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:06.343918 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5b2d4037-d8df-43aa-9e86-85e51e736c73 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:06.344408 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5b2d4037-d8df-43aa-9e86-85e51e736c73 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:06.344848 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5b2d4037-d8df-43aa-9e86-85e51e736c73 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:06.345540 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5b2d4037-d8df-43aa-9e86-85e51e736c73 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:06.346003 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5b2d4037-d8df-43aa-9e86-85e51e736c73 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:06.346431 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-5b2d4037-d8df-43aa-9e86-85e51e736c73 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:06.401399 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-15fa184e-b6f5-4a9e-992f-3a68b694a221 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:06.402585 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-15fa184e-b6f5-4a9e-992f-3a68b694a221 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:06.409211 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15fa184e-b6f5-4a9e-992f-3a68b694a221 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:06.409690 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15fa184e-b6f5-4a9e-992f-3a68b694a221 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:06.410123 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15fa184e-b6f5-4a9e-992f-3a68b694a221 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:06.410802 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15fa184e-b6f5-4a9e-992f-3a68b694a221 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:06.411254 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15fa184e-b6f5-4a9e-992f-3a68b694a221 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:06.411712 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-15fa184e-b6f5-4a9e-992f-3a68b694a221 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:06.477398 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-5b2d4037-d8df-43aa-9e86-85e51e736c73 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:06.493053 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-5b2d4037-d8df-43aa-9e86-85e51e736c73 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1367 microversion: 2.1 time: 0.160347 Sep 09 21:41:06.493876 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 542/1062] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:06 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:41:06.550492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-15fa184e-b6f5-4a9e-992f-3a68b694a221 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:06.558709 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-15fa184e-b6f5-4a9e-992f-3a68b694a221 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1265 microversion: 2.1 time: 0.161021 Sep 09 21:41:06.559790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 521/1063] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:06 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:41:07.515624 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2957e10a-1823-41b2-91f4-ff58835b5f9a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:07.516236 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2957e10a-1823-41b2-91f4-ff58835b5f9a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:07.519556 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:07.523339 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2957e10a-1823-41b2-91f4-ff58835b5f9a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:07.523852 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2957e10a-1823-41b2-91f4-ff58835b5f9a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:07.524294 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2957e10a-1823-41b2-91f4-ff58835b5f9a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:07.524983 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2957e10a-1823-41b2-91f4-ff58835b5f9a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:07.525444 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2957e10a-1823-41b2-91f4-ff58835b5f9a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:07.525873 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2957e10a-1823-41b2-91f4-ff58835b5f9a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:07.584933 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a11f42cb-1494-4c9e-81c7-2b3d38011142 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:07.586749 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-a11f42cb-1494-4c9e-81c7-2b3d38011142 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:07.593520 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a11f42cb-1494-4c9e-81c7-2b3d38011142 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:07.594011 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a11f42cb-1494-4c9e-81c7-2b3d38011142 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:07.594447 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a11f42cb-1494-4c9e-81c7-2b3d38011142 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:07.595142 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a11f42cb-1494-4c9e-81c7-2b3d38011142 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:07.595632 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a11f42cb-1494-4c9e-81c7-2b3d38011142 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:07.596061 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-a11f42cb-1494-4c9e-81c7-2b3d38011142 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:07.661275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-2957e10a-1823-41b2-91f4-ff58835b5f9a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:07.670137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2957e10a-1823-41b2-91f4-ff58835b5f9a tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1367 microversion: 2.1 time: 0.158438 Sep 09 21:41:07.670710 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 543/1064] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:07 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:41:07.727885 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-a11f42cb-1494-4c9e-81c7-2b3d38011142 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:07.736472 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a11f42cb-1494-4c9e-81c7-2b3d38011142 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1451 microversion: 2.1 time: 0.155669 Sep 09 21:41:07.737023 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 522/1065] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:07 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:41:07.758137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-0172654f-24d9-4b24-a7e5-f1888d0ee8e0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:07.758746 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-0172654f-24d9-4b24-a7e5-f1888d0ee8e0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:07.764960 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0172654f-24d9-4b24-a7e5-f1888d0ee8e0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:07.765446 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0172654f-24d9-4b24-a7e5-f1888d0ee8e0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:07.765944 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0172654f-24d9-4b24-a7e5-f1888d0ee8e0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:07.766572 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0172654f-24d9-4b24-a7e5-f1888d0ee8e0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:07.767024 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0172654f-24d9-4b24-a7e5-f1888d0ee8e0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:07.767444 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-0172654f-24d9-4b24-a7e5-f1888d0ee8e0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:07.884892 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=4 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:07.894996 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-0172654f-24d9-4b24-a7e5-f1888d0ee8e0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:07.903017 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-0172654f-24d9-4b24-a7e5-f1888d0ee8e0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1451 microversion: 2.1 time: 0.148700 Sep 09 21:41:07.903597 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 544/1066] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:07 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:41:08.379984 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-cdb8efbb-dba4-472d-8ecc-7e96ae45be74 req-661e1c01-ec60-40ca-ab17-de11d341324a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48da7195-9699-404f-b9a9-f183ac3d42db", "name": "network-vif-plugged", "status": "completed", "tag": "c5c09938-e4db-4532-b8c8-2c5de5880e73"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:41:08.385344 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell0:SELECT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:08.392273 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-cdb8efbb-dba4-472d-8ecc-7e96ae45be74 req-661e1c01-ec60-40ca-ab17-de11d341324a service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:08.392898 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-cdb8efbb-dba4-472d-8ecc-7e96ae45be74 req-661e1c01-ec60-40ca-ab17-de11d341324a service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:08.393619 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-cdb8efbb-dba4-472d-8ecc-7e96ae45be74 req-661e1c01-ec60-40ca-ab17-de11d341324a service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:08.409695 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-cdb8efbb-dba4-472d-8ecc-7e96ae45be74 req-661e1c01-ec60-40ca-ab17-de11d341324a service nova] Creating event network-vif-plugged:c5c09938-e4db-4532-b8c8-2c5de5880e73 for instance 48da7195-9699-404f-b9a9-f183ac3d42db on hv-cinder-85221 Sep 09 21:41:08.414733 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-cdb8efbb-dba4-472d-8ecc-7e96ae45be74 req-661e1c01-ec60-40ca-ab17-de11d341324a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038595 Sep 09 21:41:08.415900 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 523/1067] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:41:08.694524 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f1970661-fd54-4928-b6ff-097abb471d64 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:08.695216 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-f1970661-fd54-4928-b6ff-097abb471d64 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:08.697010 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell0:SELECT=18 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:41:08.703014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f1970661-fd54-4928-b6ff-097abb471d64 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:08.703499 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f1970661-fd54-4928-b6ff-097abb471d64 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:08.703965 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f1970661-fd54-4928-b6ff-097abb471d64 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:08.704654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f1970661-fd54-4928-b6ff-097abb471d64 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:08.705109 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f1970661-fd54-4928-b6ff-097abb471d64 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:08.705532 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-f1970661-fd54-4928-b6ff-097abb471d64 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:08.924630 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-f1970661-fd54-4928-b6ff-097abb471d64 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:08.932377 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f1970661-fd54-4928-b6ff-097abb471d64 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1367 microversion: 2.1 time: 0.242013 Sep 09 21:41:08.932951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 545/1068] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:08 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:41:09.684981 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-f7abce44-148f-4863-b85f-f542514d3716 req-056a7b6a-e898-4fdb-962f-7de5d786626e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff789631-8cfd-4414-aba7-d8cffbcffe32", "tag": "5c4e35f0-ebe2-4f02-a6e9-49793cd6fab7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:41:09.694558 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-f7abce44-148f-4863-b85f-f542514d3716 req-056a7b6a-e898-4fdb-962f-7de5d786626e service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:09.695048 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-f7abce44-148f-4863-b85f-f542514d3716 req-056a7b6a-e898-4fdb-962f-7de5d786626e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:09.695563 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-f7abce44-148f-4863-b85f-f542514d3716 req-056a7b6a-e898-4fdb-962f-7de5d786626e service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:09.706537 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-f7abce44-148f-4863-b85f-f542514d3716 req-056a7b6a-e898-4fdb-962f-7de5d786626e service nova] Creating event network-changed:5c4e35f0-ebe2-4f02-a6e9-49793cd6fab7 for instance ff789631-8cfd-4414-aba7-d8cffbcffe32 on hv-cinder-85221 Sep 09 21:41:09.711305 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-f7abce44-148f-4863-b85f-f542514d3716 req-056a7b6a-e898-4fdb-962f-7de5d786626e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031507 Sep 09 21:41:09.711939 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 524/1069] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:41:09.954661 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ea7bc12d-45a6-4ab5-b5ce-70d259b7426b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:09.955554 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-ea7bc12d-45a6-4ab5-b5ce-70d259b7426b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:09.962083 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea7bc12d-45a6-4ab5-b5ce-70d259b7426b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:09.962570 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea7bc12d-45a6-4ab5-b5ce-70d259b7426b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:09.963033 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea7bc12d-45a6-4ab5-b5ce-70d259b7426b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:09.963761 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea7bc12d-45a6-4ab5-b5ce-70d259b7426b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:09.964216 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea7bc12d-45a6-4ab5-b5ce-70d259b7426b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:09.965232 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-ea7bc12d-45a6-4ab5-b5ce-70d259b7426b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:10.098709 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-ea7bc12d-45a6-4ab5-b5ce-70d259b7426b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:10.106472 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ea7bc12d-45a6-4ab5-b5ce-70d259b7426b tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1367 microversion: 2.1 time: 0.155841 Sep 09 21:41:10.107039 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 546/1070] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:09 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:41:11.130706 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-c056d897-3df4-4f71-9e19-7fe61cc00f31 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:11.131403 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-c056d897-3df4-4f71-9e19-7fe61cc00f31 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:11.138141 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c056d897-3df4-4f71-9e19-7fe61cc00f31 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:11.138618 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c056d897-3df4-4f71-9e19-7fe61cc00f31 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:11.139052 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c056d897-3df4-4f71-9e19-7fe61cc00f31 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:11.140112 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c056d897-3df4-4f71-9e19-7fe61cc00f31 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:11.140711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c056d897-3df4-4f71-9e19-7fe61cc00f31 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:11.141233 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-c056d897-3df4-4f71-9e19-7fe61cc00f31 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:11.273205 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-c056d897-3df4-4f71-9e19-7fe61cc00f31 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:41:11.280894 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-c056d897-3df4-4f71-9e19-7fe61cc00f31 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1558 microversion: 2.1 time: 0.154817 Sep 09 21:41:11.281515 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 525/1071] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:41:11 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:41:11.303595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-67615640-afe1-4b21-bdc8-e3891d1420be tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:41:11.304095 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-67615640-afe1-4b21-bdc8-e3891d1420be tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:41:11.311221 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67615640-afe1-4b21-bdc8-e3891d1420be tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:11.311730 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67615640-afe1-4b21-bdc8-e3891d1420be tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:11.312167 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67615640-afe1-4b21-bdc8-e3891d1420be tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:11.312847 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67615640-afe1-4b21-bdc8-e3891d1420be tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:11.313304 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67615640-afe1-4b21-bdc8-e3891d1420be tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:11.313725 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-67615640-afe1-4b21-bdc8-e3891d1420be tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:11.395841 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-67615640-afe1-4b21-bdc8-e3891d1420be tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096010 Sep 09 21:41:11.396453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 547/1072] 10.222.0.46 () {58 vars in 1275 bytes} [Fri Sep 9 21:41:11 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:41:12.579513 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-7cd8d841-5a64-4574-9cce-f2056be9a24e req-e5e7c0f2-8e54-46a1-931c-806b466de19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48da7195-9699-404f-b9a9-f183ac3d42db", "tag": "c5c09938-e4db-4532-b8c8-2c5de5880e73"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:41:12.589154 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-7cd8d841-5a64-4574-9cce-f2056be9a24e req-e5e7c0f2-8e54-46a1-931c-806b466de19f service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:41:12.589636 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-7cd8d841-5a64-4574-9cce-f2056be9a24e req-e5e7c0f2-8e54-46a1-931c-806b466de19f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:41:12.590069 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-7cd8d841-5a64-4574-9cce-f2056be9a24e req-e5e7c0f2-8e54-46a1-931c-806b466de19f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:41:12.600830 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-7cd8d841-5a64-4574-9cce-f2056be9a24e req-e5e7c0f2-8e54-46a1-931c-806b466de19f service nova] Creating event network-changed:c5c09938-e4db-4532-b8c8-2c5de5880e73 for instance 48da7195-9699-404f-b9a9-f183ac3d42db on hv-cinder-85221 Sep 09 21:41:12.605685 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-7cd8d841-5a64-4574-9cce-f2056be9a24e req-e5e7c0f2-8e54-46a1-931c-806b466de19f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029787 Sep 09 21:41:12.607228 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 526/1073] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:27.522952 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=8 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:27.523749 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=46 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:27.527926 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-131c6a04-af9e-4f0b-9649-1a79d0118565 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:27.528422 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-131c6a04-af9e-4f0b-9649-1a79d0118565 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:27.535552 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-131c6a04-af9e-4f0b-9649-1a79d0118565 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:27.536396 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-131c6a04-af9e-4f0b-9649-1a79d0118565 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:27.536910 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-131c6a04-af9e-4f0b-9649-1a79d0118565 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:27.537599 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-131c6a04-af9e-4f0b-9649-1a79d0118565 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:27.538086 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-131c6a04-af9e-4f0b-9649-1a79d0118565 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:27.538490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-131c6a04-af9e-4f0b-9649-1a79d0118565 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:27.562453 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-131c6a04-af9e-4f0b-9649-1a79d0118565 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/ips" status: 200 len: 150 microversion: 2.1 time: 0.041576 Sep 09 21:42:27.563014 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 548/1074] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:42:27 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:28.899924 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=52 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:28.900721 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=30 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:28.901766 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:42:28.901932 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Fri Sep 9 21:42:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-volume_attachments (ip 10.222.0.46) !!! Sep 09 21:42:28.903329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:42:28.903468 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Fri Sep 9 21:42:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-volume_attachments (ip 10.222.0.46) !!! Sep 09 21:42:28.908776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-6f0843b7-d939-4140-9eab-ce7493d71271 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47891311-e6c4-4447-bde1-896c5470a6de"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:42:28.911725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-6f0843b7-d939-4140-9eab-ce7493d71271 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:28.921651 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f0843b7-d939-4140-9eab-ce7493d71271 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:28.922141 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f0843b7-d939-4140-9eab-ce7493d71271 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:28.922584 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f0843b7-d939-4140-9eab-ce7493d71271 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:28.923280 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f0843b7-d939-4140-9eab-ce7493d71271 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:28.923776 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f0843b7-d939-4140-9eab-ce7493d71271 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:28.924209 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-6f0843b7-d939-4140-9eab-ce7493d71271 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:29.185917 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-6f0843b7-d939-4140-9eab-ce7493d71271 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "POST /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287824 Sep 09 21:42:29.186681 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 527/1075] 10.222.0.46 () {60 vars in 1323 bytes} [Fri Sep 9 21:42:28 2022] POST /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:36.827909 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8c37672f-ae14-4821-9317-d7e907424e66 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:36.828404 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8c37672f-ae14-4821-9317-d7e907424e66 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:36.835975 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8c37672f-ae14-4821-9317-d7e907424e66 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:36.836467 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8c37672f-ae14-4821-9317-d7e907424e66 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:36.836913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8c37672f-ae14-4821-9317-d7e907424e66 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:36.837607 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8c37672f-ae14-4821-9317-d7e907424e66 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:36.838064 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8c37672f-ae14-4821-9317-d7e907424e66 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:36.838490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8c37672f-ae14-4821-9317-d7e907424e66 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:36.923611 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-8c37672f-ae14-4821-9317-d7e907424e66 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lazy-loading 'services' on Instance uuid 48da7195-9699-404f-b9a9-f183ac3d42db {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:42:36.999110 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8c37672f-ae14-4821-9317-d7e907424e66 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-volume_attachments/47891311-e6c4-4447-bde1-896c5470a6de" status: 202 len: 0 microversion: 2.1 time: 0.175092 Sep 09 21:42:36.999729 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 549/1076] 10.222.0.46 () {58 vars in 1416 bytes} [Fri Sep 9 21:42:36 2022] DELETE /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-volume_attachments/47891311-e6c4-4447-bde1-896c5470a6de => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:42:37.009719 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-fa167a18-b4f9-4cea-aa31-bb7766014731 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:37.012255 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-fa167a18-b4f9-4cea-aa31-bb7766014731 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:37.019619 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fa167a18-b4f9-4cea-aa31-bb7766014731 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:37.020119 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fa167a18-b4f9-4cea-aa31-bb7766014731 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:37.020561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fa167a18-b4f9-4cea-aa31-bb7766014731 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:37.021261 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fa167a18-b4f9-4cea-aa31-bb7766014731 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:37.021774 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fa167a18-b4f9-4cea-aa31-bb7766014731 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:37.022206 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-fa167a18-b4f9-4cea-aa31-bb7766014731 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:37.053703 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-fa167a18-b4f9-4cea-aa31-bb7766014731 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049062 Sep 09 21:42:37.054269 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 528/1077] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:42:37 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:38.067960 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b28b2c2e-8efe-4829-9437-aa72c4e5d2c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:38.070276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b28b2c2e-8efe-4829-9437-aa72c4e5d2c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:38.076836 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b28b2c2e-8efe-4829-9437-aa72c4e5d2c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:38.077345 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b28b2c2e-8efe-4829-9437-aa72c4e5d2c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:38.077784 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b28b2c2e-8efe-4829-9437-aa72c4e5d2c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:38.078475 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b28b2c2e-8efe-4829-9437-aa72c4e5d2c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:38.078928 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b28b2c2e-8efe-4829-9437-aa72c4e5d2c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:38.079350 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b28b2c2e-8efe-4829-9437-aa72c4e5d2c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:38.111040 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b28b2c2e-8efe-4829-9437-aa72c4e5d2c8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048224 Sep 09 21:42:38.111615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 550/1078] 10.222.0.46 () {58 vars in 1302 bytes} [Fri Sep 9 21:42:38 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:42:38.175681 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2bc8a63c-5a9e-44e5-a5b6-ef7f52598018 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:38.176202 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2bc8a63c-5a9e-44e5-a5b6-ef7f52598018 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:38.183082 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bc8a63c-5a9e-44e5-a5b6-ef7f52598018 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:38.183613 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bc8a63c-5a9e-44e5-a5b6-ef7f52598018 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:38.184035 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bc8a63c-5a9e-44e5-a5b6-ef7f52598018 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:38.184714 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bc8a63c-5a9e-44e5-a5b6-ef7f52598018 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:38.185164 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bc8a63c-5a9e-44e5-a5b6-ef7f52598018 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:38.185583 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2bc8a63c-5a9e-44e5-a5b6-ef7f52598018 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:38.209713 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2bc8a63c-5a9e-44e5-a5b6-ef7f52598018 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:42:38.283648 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2bc8a63c-5a9e-44e5-a5b6-ef7f52598018 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 204 len: 0 microversion: 2.1 time: 0.111365 Sep 09 21:42:38.284201 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 529/1079] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:42:38 2022] DELETE /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:42:38.293545 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8d8cdd37-62ef-4025-88b7-8ca1f906614e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:38.294152 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8d8cdd37-62ef-4025-88b7-8ca1f906614e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:38.300348 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8d8cdd37-62ef-4025-88b7-8ca1f906614e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:38.300825 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8d8cdd37-62ef-4025-88b7-8ca1f906614e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:38.301257 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8d8cdd37-62ef-4025-88b7-8ca1f906614e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:38.302048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8d8cdd37-62ef-4025-88b7-8ca1f906614e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:38.302490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8d8cdd37-62ef-4025-88b7-8ca1f906614e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:38.302911 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8d8cdd37-62ef-4025-88b7-8ca1f906614e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:38.436988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8d8cdd37-62ef-4025-88b7-8ca1f906614e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:42:38.444786 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8d8cdd37-62ef-4025-88b7-8ca1f906614e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1682 microversion: 2.1 time: 0.155212 Sep 09 21:42:38.445340 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 551/1080] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:42:38 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:42:39.469147 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-61e12885-d562-4d04-93dc-da0894b24af9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:39.469850 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-61e12885-d562-4d04-93dc-da0894b24af9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:39.477179 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-61e12885-d562-4d04-93dc-da0894b24af9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:39.477668 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-61e12885-d562-4d04-93dc-da0894b24af9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:39.478110 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-61e12885-d562-4d04-93dc-da0894b24af9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:39.478803 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-61e12885-d562-4d04-93dc-da0894b24af9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:39.479263 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-61e12885-d562-4d04-93dc-da0894b24af9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:39.479727 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-61e12885-d562-4d04-93dc-da0894b24af9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:39.615028 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-61e12885-d562-4d04-93dc-da0894b24af9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:42:39.622979 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-61e12885-d562-4d04-93dc-da0894b24af9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1682 microversion: 2.1 time: 0.158066 Sep 09 21:42:39.623561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 530/1081] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:42:39 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:42:40.647003 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7642fbbc-46a7-46ad-bbf6-f5258d6aa880 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:40.647654 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-7642fbbc-46a7-46ad-bbf6-f5258d6aa880 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:40.654149 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7642fbbc-46a7-46ad-bbf6-f5258d6aa880 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:40.654635 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7642fbbc-46a7-46ad-bbf6-f5258d6aa880 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:40.655074 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7642fbbc-46a7-46ad-bbf6-f5258d6aa880 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:40.655814 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7642fbbc-46a7-46ad-bbf6-f5258d6aa880 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:40.656265 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7642fbbc-46a7-46ad-bbf6-f5258d6aa880 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:40.656698 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-7642fbbc-46a7-46ad-bbf6-f5258d6aa880 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:40.790229 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-7642fbbc-46a7-46ad-bbf6-f5258d6aa880 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:42:40.798213 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7642fbbc-46a7-46ad-bbf6-f5258d6aa880 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1682 microversion: 2.1 time: 0.155828 Sep 09 21:42:40.798774 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 552/1082] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:42:40 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:42:41.220870 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-ce28faf2-2370-44db-ad66-5ba987cb3619 req-e71d608a-fdc3-48e6-8d1c-72811107c44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48da7195-9699-404f-b9a9-f183ac3d42db", "name": "network-vif-deleted", "tag": "c5c09938-e4db-4532-b8c8-2c5de5880e73"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:42:41.236064 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-ce28faf2-2370-44db-ad66-5ba987cb3619 req-e71d608a-fdc3-48e6-8d1c-72811107c44b service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:41.236663 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-ce28faf2-2370-44db-ad66-5ba987cb3619 req-e71d608a-fdc3-48e6-8d1c-72811107c44b service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:41.237165 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-ce28faf2-2370-44db-ad66-5ba987cb3619 req-e71d608a-fdc3-48e6-8d1c-72811107c44b service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:41.250465 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-ce28faf2-2370-44db-ad66-5ba987cb3619 req-e71d608a-fdc3-48e6-8d1c-72811107c44b service nova] Creating event network-vif-deleted:c5c09938-e4db-4532-b8c8-2c5de5880e73 for instance 48da7195-9699-404f-b9a9-f183ac3d42db on hv-cinder-85221 Sep 09 21:42:41.255719 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-ce28faf2-2370-44db-ad66-5ba987cb3619 req-e71d608a-fdc3-48e6-8d1c-72811107c44b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121346 Sep 09 21:42:41.256320 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 531/1083] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:41.823563 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:41.824972 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:41.831938 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:41.832910 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:41.833375 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:41.834152 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:41.834614 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:41.835047 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:41.872823 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:41.873315 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:41.873755 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:41.874402 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.objects.instance [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lazy-loading 'fault' on Instance uuid 48da7195-9699-404f-b9a9-f183ac3d42db {{(pid=120465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:42:41.921762 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70dcf397dc04470b9756119a9fe8f6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cca63adb761474d82636997dade783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:42:41.933242 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b750959b-d74c-4e2b-a028-bc1ad1a49318 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 200 len: 1331 microversion: 2.1 time: 0.113295 Sep 09 21:42:41.934933 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 553/1084] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:42:41 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:42:42.957848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:42.958544 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:42.964657 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:42.965142 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:42.965579 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:42.966263 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:42.966720 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:42.967156 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:42.980280 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db HTTP/1.1 Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:42:42.981912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:42.983711 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '48da7195-9699-404f-b9a9-f183ac3d42db'} Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:42:42.984765 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:42.986190 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:42.987561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:42:42.987561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-679bf8c3-c0a0-4873-b2f5-5447057abfef tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 404 len: 111 microversion: 2.1 time: 0.030189 Sep 09 21:42:42.987561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 532/1085] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:42:42 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:42:42.992563 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2465b6fd-9991-4248-b974-459e454bab20 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '.version_select at 0x7f081333eb80>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:43.011094 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2465b6fd-9991-4248-b974-459e454bab20 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781050286" status: 202 len: 0 microversion: 2.1 time: 0.022834 Sep 09 21:42:43.011675 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 554/1086] 10.222.0.46 () {58 vars in 1221 bytes} [Fri Sep 9 21:42:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781050286 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:42:44.742012 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:44.742518 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:44.748912 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:44.749345 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:44.749785 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:44.750466 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:44.750923 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:44.751350 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:44.764522 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db HTTP/1.1 Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:42:44.766168 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:44.767878 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '48da7195-9699-404f-b9a9-f183ac3d42db'} Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:42:44.769086 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:44.771026 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:44.772691 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:42:44.772691 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-2f3cfe47-5113-4976-877b-0a25a7228247 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 404 len: 111 microversion: 2.1 time: 0.029890 Sep 09 21:42:44.772691 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 533/1087] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:42:44 2022] DELETE /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:42:44.776105 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:44.776727 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 48da7195-9699-404f-b9a9-f183ac3d42db] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:44.783212 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:44.783744 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:44.784187 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:44.784871 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:44.785327 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:44.786266 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:44.799480 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db HTTP/1.1 Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:42:44.801122 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:44.803957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '48da7195-9699-404f-b9a9-f183ac3d42db'} Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:42:44.804951 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. Sep 09 21:42:44.806595 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:44.808210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 48da7195-9699-404f-b9a9-f183ac3d42db could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:42:44.808210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-2773e932-9183-496c-a21f-26f3df17d5b9 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db" status: 404 len: 111 microversion: 2.1 time: 0.031292 Sep 09 21:42:44.808210 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 555/1088] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:42:44 2022] GET /compute/v2.1/servers/48da7195-9699-404f-b9a9-f183ac3d42db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:42:45.946895 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:45.947408 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:45.953769 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:45.954243 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:45.954672 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:45.955346 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:45.955830 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:45.956254 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:45.971561 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f HTTP/1.1 Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:42:45.973071 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:42:45.974874 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '07ff12f3-8e9e-4811-b65a-0d1a1d15419f'} Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:42:45.976074 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:42:45.977790 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:45.979492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:42:45.979492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-56e16a5c-9abd-4bf3-9f0e-df4a19c8c358 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 404 len: 111 microversion: 2.1 time: 0.031452 Sep 09 21:42:45.979492 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 534/1089] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:42:45 2022] DELETE /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:42:45.982809 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:45.983462 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 07ff12f3-8e9e-4811-b65a-0d1a1d15419f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:45.990342 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:45.990827 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:45.991270 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:45.992024 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:45.992483 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:45.992913 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:46.006878 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f HTTP/1.1 Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:42:46.008426 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:42:46.010185 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '07ff12f3-8e9e-4811-b65a-0d1a1d15419f'} Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:42:46.011054 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. Sep 09 21:42:46.012457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.013669 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 07ff12f3-8e9e-4811-b65a-0d1a1d15419f could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:42:46.013669 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-add5b6f3-1b70-4475-a383-cd45001a94ba tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f" status: 404 len: 111 microversion: 2.1 time: 0.030796 Sep 09 21:42:46.013669 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 556/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:42:45 2022] GET /compute/v2.1/servers/07ff12f3-8e9e-4811-b65a-0d1a1d15419f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:42:46.018345 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:46.018939 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:46.025032 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:46.025521 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:46.025964 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:46.026651 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:46.027108 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:46.027557 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:46.040736 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 HTTP/1.1 Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:42:46.042262 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:42:46.044024 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '4d540826-35c1-46aa-935a-fa409f5a64f6'} Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:42:46.045013 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:42:46.046903 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.048500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:42:46.048500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-184156a6-3cd0-4c5a-a2c1-967bc4b1723e tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 404 len: 111 microversion: 2.1 time: 0.029148 Sep 09 21:42:46.048500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 535/1091] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:42:46 2022] DELETE /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:42:46.052778 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:46.053391 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 4d540826-35c1-46aa-935a-fa409f5a64f6] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:46.059168 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:46.059690 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:46.060126 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:46.060812 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:46.061299 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:46.061725 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:46.075370 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 HTTP/1.1 Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:42:46.076894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:42:46.078568 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '4d540826-35c1-46aa-935a-fa409f5a64f6'} Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:42:46.079562 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. Sep 09 21:42:46.081137 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:46.082826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 4d540826-35c1-46aa-935a-fa409f5a64f6 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:42:46.082826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-081ea564-9b70-4070-84d2-652afa525ca8 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6" status: 404 len: 111 microversion: 2.1 time: 0.029845 Sep 09 21:42:46.082826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 557/1092] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:42:46 2022] GET /compute/v2.1/servers/4d540826-35c1-46aa-935a-fa409f5a64f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:42:47.216396 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:47.216906 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:47.223625 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:47.224120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:47.224552 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:47.225227 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:47.225678 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:47.226099 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:47.239834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 HTTP/1.1 Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:42:47.241342 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:42:47.243027 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '8ac7aa13-bffc-474e-aef4-ee08d9428655'} Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:42:47.244116 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:42:47.245799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:47.247467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:42:47.247467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-9060bd47-e58a-4fd6-bec1-fc4f0cede180 tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 404 len: 111 microversion: 2.1 time: 0.030108 Sep 09 21:42:47.247467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 536/1093] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:42:47 2022] DELETE /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:42:47.250957 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:47.251861 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] [instance: 8ac7aa13-bffc-474e-aef4-ee08d9428655] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:42:47.258963 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:47.259444 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:47.259915 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:47.260606 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:42:47.261065 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:42:47.261494 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:42:47.275526 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] HTTP exception thrown: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Request method failure captured: Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 HTTP/1.1 Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7G3sZMYzotyPzVwkX1X4GFHQ8bfm5WsLvhRTTKZKDe45XkhfBe1TOrQUC4m7wj_4S3v29zc-cQAetemReSimHtA6pinj7xQ_g_VoTwITyNPTgetRwuzqE-15GotuJQaPzVGaNLnTQz5EGITViwm9ig19_UeMjzZ-QBBrRiWyL5eESU Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:42:47.277041 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca63adb761474d82636997dade783a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca63adb761474d82636997dade783a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca63adb761474d82636997dade783a"}]}] Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 7cca63adb761474d82636997dade783a Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2125483321 Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 70dcf397dc04470b9756119a9fe8f6a6 Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-AttachVolumeNegativeTest-2125483321-project Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:42:47.278739 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '8ac7aa13-bffc-474e-aef4-ee08d9428655'} Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:42:47.279874 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. Sep 09 21:42:47.281488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:42:47.283007 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] Returning 404 to user: Instance 8ac7aa13-bffc-474e-aef4-ee08d9428655 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:42:47.283007 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8cbbf649-1f69-4c97-bb89-7438b46d918c tempest-AttachVolumeNegativeTest-2125483321 tempest-AttachVolumeNegativeTest-2125483321-project] 10.222.0.46 "GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655" status: 404 len: 111 microversion: 2.1 time: 0.031223 Sep 09 21:42:47.283007 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 558/1094] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:42:47 2022] GET /compute/v2.1/servers/8ac7aa13-bffc-474e-aef4-ee08d9428655 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:42:51.773387 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-03bfe5dc-f564-4226-afc8-f0e612091ac9 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Action: 'create', calling method: .version_select at 0x7f0812f09550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1688214302"}} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:42:52.083416 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-03bfe5dc-f564-4226-afc8-f0e612091ac9 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.423329 Sep 09 21:42:52.084322 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 537/1095] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Sep 9 21:42:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 425 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 21:42:52.097205 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-e28d6658-3823-4fc5-ad89-1dba25b34bee tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0813036af0>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:52.148412 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-e28d6658-3823-4fc5-ad89-1dba25b34bee tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35" status: 200 len: 345 microversion: 2.1 time: 0.055084 Sep 09 21:42:52.149277 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 559/1096] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:42:52 2022] GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:53.164010 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-7f6fc712-6ae7-41ad-a0cc-fec3b9a92759 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812ee4ee0>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:53.210351 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-7f6fc712-6ae7-41ad-a0cc-fec3b9a92759 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35" status: 200 len: 346 microversion: 2.1 time: 0.050850 Sep 09 21:42:53.210911 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 538/1097] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:42:53 2022] GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:53.224231 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-f624b6d9-b1be-42b0-b029-b33e0b55ea61 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Action: 'create', calling method: .version_select at 0x7f08131ef040>, body: {"snapshot": {"volume_id": "1de25cca-4419-4cab-9cd8-1049add97f35", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1577721612"}} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:42:53.374298 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-f624b6d9-b1be-42b0-b029-b33e0b55ea61 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.154411 Sep 09 21:42:53.374880 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 560/1098] 10.222.0.46 () {60 vars in 1162 bytes} [Fri Sep 9 21:42:53 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:42:53.387300 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-00e9ee17-6e85-4feb-9b39-49e322443fc3 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812e413a0>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:53.418276 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-00e9ee17-6e85-4feb-9b39-49e322443fc3 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7" status: 200 len: 287 microversion: 2.1 time: 0.034777 Sep 09 21:42:53.418834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 539/1099] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 21:42:53 2022] GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:53.430765 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-77b8b4eb-6f1e-4539-ae62-1fbcffef9647 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0813036160>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:53.461307 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-77b8b4eb-6f1e-4539-ae62-1fbcffef9647 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034962 Sep 09 21:42:53.461866 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 561/1100] 10.222.0.46 () {58 vars in 1140 bytes} [Fri Sep 9 21:42:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:53.472883 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-84e44935-9b2d-4767-8bf5-ba3606fa9dcc tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812ee43a0>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:53.502589 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-84e44935-9b2d-4767-8bf5-ba3606fa9dcc tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7" status: 200 len: 287 microversion: 2.1 time: 0.033486 Sep 09 21:42:53.503134 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 540/1101] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 21:42:53 2022] GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:54.516313 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ef7ed520-6bbe-4592-bcb8-fc701150cb3a tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0813dd1820>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:54.548806 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ef7ed520-6bbe-4592-bcb8-fc701150cb3a tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7" status: 200 len: 287 microversion: 2.1 time: 0.036764 Sep 09 21:42:54.549372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 562/1102] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 21:42:54 2022] GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:55.562120 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-27d28c51-6de8-483c-be1c-3f35a11eaae6 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812d8fb80>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:55.591412 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-27d28c51-6de8-483c-be1c-3f35a11eaae6 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7" status: 200 len: 287 microversion: 2.1 time: 0.033523 Sep 09 21:42:55.591979 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 541/1103] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 21:42:55 2022] GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:56.604787 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-bdb1fa4a-a920-40dc-a31a-ff57dfc8c1e5 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812fd7e50>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:56.636790 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-bdb1fa4a-a920-40dc-a31a-ff57dfc8c1e5 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7" status: 200 len: 287 microversion: 2.1 time: 0.036239 Sep 09 21:42:56.637456 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 563/1104] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 21:42:56 2022] GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:57.647477 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:57.648305 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG dbcounter [-] [120466] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:57.652529 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-700fe50c-83a7-4356-96b5-6b7251253542 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812de4f70>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:57.682945 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-700fe50c-83a7-4356-96b5-6b7251253542 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7" status: 200 len: 287 microversion: 2.1 time: 0.036680 Sep 09 21:42:57.683498 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 542/1105] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 21:42:57 2022] GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:58.694275 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:58.695505 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG dbcounter [-] [120465] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:42:58.700921 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-a9096734-29dd-44ae-b67a-4a95e76caae9 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812fc1ee0>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:58.731329 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-a9096734-29dd-44ae-b67a-4a95e76caae9 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7" status: 200 len: 288 microversion: 2.1 time: 0.039054 Sep 09 21:42:58.731910 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 564/1106] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 21:42:58 2022] GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:58.743929 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a923a0a3-ce47-4e42-9604-3206bb6dea53 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812e51550>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:58.800118 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a923a0a3-ce47-4e42-9604-3206bb6dea53 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7" status: 202 len: 0 microversion: 2.1 time: 0.060882 Sep 09 21:42:58.800682 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 543/1107] 10.222.0.46 () {58 vars in 1254 bytes} [Fri Sep 9 21:42:58 2022] DELETE /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 21:42:58.810017 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c8892073-6c34-4dd8-a4cd-989c63cfec71 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f08167bd3a0>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:58.839125 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c8892073-6c34-4dd8-a4cd-989c63cfec71 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7" status: 200 len: 287 microversion: 2.1 time: 0.033074 Sep 09 21:42:58.839712 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 565/1108] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 21:42:58 2022] GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:42:59.852559 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a8575ad8-78e2-4059-ad58-2077866a21f9 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812ee44c0>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:59.876499 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-a8575ad8-78e2-4059-ad58-2077866a21f9 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] HTTP exception thrown: Snapshot ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 could not be found. Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a8575ad8-78e2-4059-ad58-2077866a21f9 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Request method failure captured: Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 HTTP/1.1 Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7NbmnFMAQapX433YnuFNMzGBqHMIDjhOWrBwWEJPYj6h8CTsELBvU9mvKEdxaxWZpSO1FHPg21o9I3GpA-gyeBkGZqzzgCX2iZlnlFgmaYUo7a4XPYR66i5X1Qke2VyKRTHCDa4xxvHMR0B30H_u6E664-OmaIb43JZrWx2ZjE4qrE Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 147f589a02b0462fb1641e43acb254fb Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:42:59.878725 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_147f589a02b0462fb1641e43acb254fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/147f589a02b0462fb1641e43acb254fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/147f589a02b0462fb1641e43acb254fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/147f589a02b0462fb1641e43acb254fb"}]}] Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 147f589a02b0462fb1641e43acb254fb Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesSnapshotsTestJSON-1552121332-project Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 04a1343b5f7640f692d358496a1d6e01 Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1552121332-project Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Snapshot ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 could not be found. Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': 'ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7'} Sep 09 21:42:59.881304 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 could not be found. (HTTP 404) (Request-ID: req-c0cff9be-3a84-4977-9453-a3b58b440809) Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:59.882606 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:42:59.884176 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 could not be found. Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 21:42:59.886092 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 could not be found. Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 could not be found. Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-a8575ad8-78e2-4059-ad58-2077866a21f9 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Returning 404 to user: Snapshot ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:42:59.887905 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-a8575ad8-78e2-4059-ad58-2077866a21f9 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7" status: 404 len: 111 microversion: 2.1 time: 0.031911 Sep 09 21:42:59.889184 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 544/1109] 10.222.0.46 () {58 vars in 1251 bytes} [Fri Sep 9 21:42:59 2022] GET /compute/v2.1/os-snapshots/ef767ff9-5f99-47c0-b2bd-a4f5f68b3ad7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:42:59.889780 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-ba647f4b-df12-41f4-8297-7c43465f8acb tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0813079700>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:42:59.950894 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-ba647f4b-df12-41f4-8297-7c43465f8acb tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35" status: 202 len: 0 microversion: 2.1 time: 0.065232 Sep 09 21:42:59.951457 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 566/1110] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:42:59 2022] DELETE /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:42:59.960932 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-caa28b20-e2b1-4499-ac44-15cc8161d5d5 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812fd3d30>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:00.009234 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-caa28b20-e2b1-4499-ac44-15cc8161d5d5 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35" status: 200 len: 345 microversion: 2.1 time: 0.052712 Sep 09 21:43:00.009799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 545/1111] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:42:59 2022] GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:43:01.024978 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b9c67605-1d99-408c-ab37-aff155c83f38 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f08167bdca0>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:01.052801 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-b9c67605-1d99-408c-ab37-aff155c83f38 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] HTTP exception thrown: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b9c67605-1d99-408c-ab37-aff155c83f38 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Request method failure captured: Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35 HTTP/1.1 Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7NbmnFMAQapX433YnuFNMzGBqHMIDjhOWrBwWEJPYj6h8CTsELBvU9mvKEdxaxWZpSO1FHPg21o9I3GpA-gyeBkGZqzzgCX2iZlnlFgmaYUo7a4XPYR66i5X1Qke2VyKRTHCDa4xxvHMR0B30H_u6E664-OmaIb43JZrWx2ZjE4qrE Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 147f589a02b0462fb1641e43acb254fb Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:43:01.056059 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_147f589a02b0462fb1641e43acb254fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/147f589a02b0462fb1641e43acb254fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/147f589a02b0462fb1641e43acb254fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/147f589a02b0462fb1641e43acb254fb"}]}] Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 147f589a02b0462fb1641e43acb254fb Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-VolumesSnapshotsTestJSON-1552121332-project Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 04a1343b5f7640f692d358496a1d6e01 Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1552121332-project Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '1de25cca-4419-4cab-9cd8-1049add97f35'} Sep 09 21:43:01.057815 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. (HTTP 404) (Request-ID: req-0d80e7d2-16bf-43cf-9c76-1217a201e442) Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:01.058887 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:43:01.060588 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 21:43:01.062215 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-b9c67605-1d99-408c-ab37-aff155c83f38 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Returning 404 to user: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-b9c67605-1d99-408c-ab37-aff155c83f38 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35" status: 404 len: 109 microversion: 2.1 time: 0.037648 Sep 09 21:43:01.063826 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 567/1112] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:43:01 2022] GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:43:01.073331 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ae8d5da9-ab9d-4c4b-86ee-569ab0e3e73d tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f0812d710d0>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:01.104159 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-ae8d5da9-ab9d-4c4b-86ee-569ab0e3e73d tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] HTTP exception thrown: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ae8d5da9-ab9d-4c4b-86ee-569ab0e3e73d tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Request method failure captured: Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35 HTTP/1.1 Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7NbmnFMAQapX433YnuFNMzGBqHMIDjhOWrBwWEJPYj6h8CTsELBvU9mvKEdxaxWZpSO1FHPg21o9I3GpA-gyeBkGZqzzgCX2iZlnlFgmaYUo7a4XPYR66i5X1Qke2VyKRTHCDa4xxvHMR0B30H_u6E664-OmaIb43JZrWx2ZjE4qrE Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: 147f589a02b0462fb1641e43acb254fb Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:43:01.106091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_147f589a02b0462fb1641e43acb254fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/147f589a02b0462fb1641e43acb254fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/147f589a02b0462fb1641e43acb254fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/147f589a02b0462fb1641e43acb254fb"}]}] Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: 147f589a02b0462fb1641e43acb254fb Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-VolumesSnapshotsTestJSON-1552121332-project Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 04a1343b5f7640f692d358496a1d6e01 Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1552121332-project Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': '1de25cca-4419-4cab-9cd8-1049add97f35'} Sep 09 21:43:01.107861 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. (HTTP 404) (Request-ID: req-b36d435b-ae85-4dac-ab27-76de2eebdfc9) Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:01.108996 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:43:01.110551 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 21:43:01.112183 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ae8d5da9-ab9d-4c4b-86ee-569ab0e3e73d tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Returning 404 to user: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:43:01.113669 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ae8d5da9-ab9d-4c4b-86ee-569ab0e3e73d tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35" status: 404 len: 109 microversion: 2.1 time: 0.039820 Sep 09 21:43:01.114768 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 546/1113] 10.222.0.46 () {58 vars in 1248 bytes} [Fri Sep 9 21:43:01 2022] DELETE /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:43:01.116289 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7d4cd7e9-d918-47e1-9be7-cfd6aae0b4c2 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Calling method '.version_select at 0x7f08130d83a0>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:01.144493 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-7d4cd7e9-d918-47e1-9be7-cfd6aae0b4c2 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] HTTP exception thrown: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7d4cd7e9-d918-47e1-9be7-cfd6aae0b4c2 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Request method failure captured: Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35 HTTP/1.1 Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7NbmnFMAQapX433YnuFNMzGBqHMIDjhOWrBwWEJPYj6h8CTsELBvU9mvKEdxaxWZpSO1FHPg21o9I3GpA-gyeBkGZqzzgCX2iZlnlFgmaYUo7a4XPYR66i5X1Qke2VyKRTHCDa4xxvHMR0B30H_u6E664-OmaIb43JZrWx2ZjE4qrE Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: 147f589a02b0462fb1641e43acb254fb Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:43:01.147381 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_147f589a02b0462fb1641e43acb254fb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/147f589a02b0462fb1641e43acb254fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/147f589a02b0462fb1641e43acb254fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/147f589a02b0462fb1641e43acb254fb"}]}] Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: 147f589a02b0462fb1641e43acb254fb Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1552121332 Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-VolumesSnapshotsTestJSON-1552121332-project Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 04a1343b5f7640f692d358496a1d6e01 Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1552121332-project Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '1de25cca-4419-4cab-9cd8-1049add97f35'} Sep 09 21:43:01.149490 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. (HTTP 404) (Request-ID: req-6c40fa75-f269-4572-a07f-76a13026806c) Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:01.150686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:43:01.152276 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 21:43:01.154663 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-7d4cd7e9-d918-47e1-9be7-cfd6aae0b4c2 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] Returning 404 to user: Volume 1de25cca-4419-4cab-9cd8-1049add97f35 could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-7d4cd7e9-d918-47e1-9be7-cfd6aae0b4c2 tempest-VolumesSnapshotsTestJSON-1552121332 tempest-VolumesSnapshotsTestJSON-1552121332-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35" status: 404 len: 109 microversion: 2.1 time: 0.036505 Sep 09 21:43:01.156646 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 568/1114] 10.222.0.46 () {58 vars in 1245 bytes} [Fri Sep 9 21:43:01 2022] GET /compute/v2.1/os-volumes/1de25cca-4419-4cab-9cd8-1049add97f35 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:43:11.846804 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-32d8c734-3098-409e-9174-1888809a1e7d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:11.853977 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [req-ac795b07-63f5-408a-8ecf-9edbcca96c31 req-7991598a-b44c-4167-adaa-b0c990df6a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff789631-8cfd-4414-aba7-d8cffbcffe32", "tag": "5c4e35f0-ebe2-4f02-a6e9-49793cd6fab7"}]} {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:43:11.858770 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-32d8c734-3098-409e-9174-1888809a1e7d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:11.870686 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-ac795b07-63f5-408a-8ecf-9edbcca96c31 req-7991598a-b44c-4167-adaa-b0c990df6a0f service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:11.872620 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32d8c734-3098-409e-9174-1888809a1e7d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:11.873118 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32d8c734-3098-409e-9174-1888809a1e7d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:11.873749 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32d8c734-3098-409e-9174-1888809a1e7d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:11.874456 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32d8c734-3098-409e-9174-1888809a1e7d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:11.875098 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32d8c734-3098-409e-9174-1888809a1e7d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:11.875615 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-32d8c734-3098-409e-9174-1888809a1e7d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:11.880463 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-ac795b07-63f5-408a-8ecf-9edbcca96c31 req-7991598a-b44c-4167-adaa-b0c990df6a0f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:11.881123 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [req-ac795b07-63f5-408a-8ecf-9edbcca96c31 req-7991598a-b44c-4167-adaa-b0c990df6a0f service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:11.900666 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.compute.server_external_events [req-ac795b07-63f5-408a-8ecf-9edbcca96c31 req-7991598a-b44c-4167-adaa-b0c990df6a0f service nova] Creating event network-changed:5c4e35f0-ebe2-4f02-a6e9-49793cd6fab7 for instance ff789631-8cfd-4414-aba7-d8cffbcffe32 on hv-cinder-85221 Sep 09 21:43:11.906947 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-32d8c734-3098-409e-9174-1888809a1e7d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Going to try to terminate instance {{(pid=120466) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:43:11.908158 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [req-ac795b07-63f5-408a-8ecf-9edbcca96c31 req-7991598a-b44c-4167-adaa-b0c990df6a0f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058417 Sep 09 21:43:11.908936 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 569/1115] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:43:12.017516 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-32d8c734-3098-409e-9174-1888809a1e7d tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 204 len: 0 microversion: 2.1 time: 0.176119 Sep 09 21:43:12.018089 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 547/1116] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:43:11 2022] DELETE /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:43:12.029709 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-d78137d1-467e-4d32-adf7-51973a1dae23 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:12.030619 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-d78137d1-467e-4d32-adf7-51973a1dae23 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:12.040725 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d78137d1-467e-4d32-adf7-51973a1dae23 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:12.041615 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d78137d1-467e-4d32-adf7-51973a1dae23 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:12.042585 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d78137d1-467e-4d32-adf7-51973a1dae23 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:12.043667 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d78137d1-467e-4d32-adf7-51973a1dae23 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:12.044420 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d78137d1-467e-4d32-adf7-51973a1dae23 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:12.045138 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-d78137d1-467e-4d32-adf7-51973a1dae23 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:12.195271 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-d78137d1-467e-4d32-adf7-51973a1dae23 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:43:12.203216 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-d78137d1-467e-4d32-adf7-51973a1dae23 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1574 microversion: 2.1 time: 0.178421 Sep 09 21:43:12.203843 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 570/1117] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:43:12 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:43:13.226990 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-529940fa-5498-48ea-a7e2-dbc54db890d0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:13.227799 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-529940fa-5498-48ea-a7e2-dbc54db890d0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:13.234197 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-529940fa-5498-48ea-a7e2-dbc54db890d0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:13.234689 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-529940fa-5498-48ea-a7e2-dbc54db890d0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:13.235133 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-529940fa-5498-48ea-a7e2-dbc54db890d0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:13.235867 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-529940fa-5498-48ea-a7e2-dbc54db890d0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:13.236330 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-529940fa-5498-48ea-a7e2-dbc54db890d0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:13.236757 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-529940fa-5498-48ea-a7e2-dbc54db890d0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:13.478552 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-529940fa-5498-48ea-a7e2-dbc54db890d0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:43:13.486656 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-529940fa-5498-48ea-a7e2-dbc54db890d0 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1574 microversion: 2.1 time: 0.264141 Sep 09 21:43:13.487223 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 548/1118] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:43:13 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1574 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:43:14.510927 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-039c179c-e9fc-4480-b7dd-e70b624ba508 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:14.512134 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-039c179c-e9fc-4480-b7dd-e70b624ba508 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:14.518885 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-039c179c-e9fc-4480-b7dd-e70b624ba508 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:14.519859 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-039c179c-e9fc-4480-b7dd-e70b624ba508 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:14.520761 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-039c179c-e9fc-4480-b7dd-e70b624ba508 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:14.521474 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-039c179c-e9fc-4480-b7dd-e70b624ba508 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:14.521939 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-039c179c-e9fc-4480-b7dd-e70b624ba508 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:14.522372 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-039c179c-e9fc-4480-b7dd-e70b624ba508 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:14.558374 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-0e4d7951-65f6-42f2-a884-589ba8868ae2 req-425071e3-4de8-4297-9373-a0f2657dc05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff789631-8cfd-4414-aba7-d8cffbcffe32", "name": "network-vif-deleted", "tag": "5c4e35f0-ebe2-4f02-a6e9-49793cd6fab7"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:43:14.571461 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-0e4d7951-65f6-42f2-a884-589ba8868ae2 req-425071e3-4de8-4297-9373-a0f2657dc05b service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:14.571986 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-0e4d7951-65f6-42f2-a884-589ba8868ae2 req-425071e3-4de8-4297-9373-a0f2657dc05b service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:14.579106 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-0e4d7951-65f6-42f2-a884-589ba8868ae2 req-425071e3-4de8-4297-9373-a0f2657dc05b service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:14.595303 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-0e4d7951-65f6-42f2-a884-589ba8868ae2 req-425071e3-4de8-4297-9373-a0f2657dc05b service nova] Creating event network-vif-deleted:5c4e35f0-ebe2-4f02-a6e9-49793cd6fab7 for instance ff789631-8cfd-4414-aba7-d8cffbcffe32 on hv-cinder-85221 Sep 09 21:43:14.600358 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-0e4d7951-65f6-42f2-a884-589ba8868ae2 req-425071e3-4de8-4297-9373-a0f2657dc05b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051410 Sep 09 21:43:14.600986 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 549/1119] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:43:14.603202 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-039c179c-e9fc-4480-b7dd-e70b624ba508 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:43:14.611985 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-039c179c-e9fc-4480-b7dd-e70b624ba508 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 200 len: 1390 microversion: 2.1 time: 0.105542 Sep 09 21:43:14.612637 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 571/1120] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:43:14 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 1390 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:43:15.640521 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:15.641225 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: ff789631-8cfd-4414-aba7-d8cffbcffe32] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:15.647290 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:15.647816 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:15.648864 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:15.649554 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:15.650022 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:15.650447 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:15.665229 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] HTTP exception thrown: Instance ff789631-8cfd-4414-aba7-d8cffbcffe32 could not be found. Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Request method failure captured: Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 HTTP/1.1 Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7FfON-ccvRMDYJKxIU0eVME27-XOMI6ONjxEjjKkLVy7f6bJSr9ENB_6_GufjBGoUXDT3pEC7RoAjcdzkpWaB5PUKxykiLHOSb7qm_mFklL1kXYY8edWwYS0rcG4b5L2VVQTAJiIeuL4E0Mt0dcXyIQ32m-uNV9BBI7YR-ha6vO8UY Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: b9a36910972a4d87b508b918af36bbd5 Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:43:15.666848 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9a36910972a4d87b508b918af36bbd5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9a36910972a4d87b508b918af36bbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9a36910972a4d87b508b918af36bbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9a36910972a4d87b508b918af36bbd5"}]}] Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: b9a36910972a4d87b508b918af36bbd5 Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-TestVolumeBootPattern-23828200-project Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 691a25c97f4748119366c35dd4688765 Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-TestVolumeBootPattern-23828200-project Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance ff789631-8cfd-4414-aba7-d8cffbcffe32 could not be found. Sep 09 21:43:15.668500 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': 'ff789631-8cfd-4414-aba7-d8cffbcffe32'} Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff789631-8cfd-4414-aba7-d8cffbcffe32 could not be found. Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:43:15.669638 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff789631-8cfd-4414-aba7-d8cffbcffe32 could not be found. Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff789631-8cfd-4414-aba7-d8cffbcffe32 could not be found. Sep 09 21:43:15.671333 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:15.673320 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Returning 404 to user: Instance ff789631-8cfd-4414-aba7-d8cffbcffe32 could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:43:15.673320 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-8495d570-4457-4c29-a2ab-4063b043d120 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32" status: 404 len: 111 microversion: 2.1 time: 0.032613 Sep 09 21:43:15.673320 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 550/1121] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:43:15 2022] GET /compute/v2.1/servers/ff789631-8cfd-4414-aba7-d8cffbcffe32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:43:18.804571 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4a7230c2-4ee7-41e1-aa66-5a9b6ce1b7a3 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:18.805891 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4a7230c2-4ee7-41e1-aa66-5a9b6ce1b7a3 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:18.806264 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-0d720cb9-5b00-4069-be74-744848361637 req-41094f68-22a8-41f5-b552-2f5d748c3f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394a5227-01ae-4083-957d-1fe7d267a71f", "tag": "4fa80268-fdbb-44c1-8d74-a9162a890e21"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:43:18.814853 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a7230c2-4ee7-41e1-aa66-5a9b6ce1b7a3 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:18.815731 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a7230c2-4ee7-41e1-aa66-5a9b6ce1b7a3 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:18.816438 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a7230c2-4ee7-41e1-aa66-5a9b6ce1b7a3 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:18.817195 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-0d720cb9-5b00-4069-be74-744848361637 req-41094f68-22a8-41f5-b552-2f5d748c3f41 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:18.817679 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-0d720cb9-5b00-4069-be74-744848361637 req-41094f68-22a8-41f5-b552-2f5d748c3f41 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:18.817962 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a7230c2-4ee7-41e1-aa66-5a9b6ce1b7a3 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:18.818105 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-0d720cb9-5b00-4069-be74-744848361637 req-41094f68-22a8-41f5-b552-2f5d748c3f41 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:18.818768 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a7230c2-4ee7-41e1-aa66-5a9b6ce1b7a3 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:18.819407 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4a7230c2-4ee7-41e1-aa66-5a9b6ce1b7a3 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:18.830102 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-0d720cb9-5b00-4069-be74-744848361637 req-41094f68-22a8-41f5-b552-2f5d748c3f41 service nova] Creating event network-changed:4fa80268-fdbb-44c1-8d74-a9162a890e21 for instance 394a5227-01ae-4083-957d-1fe7d267a71f on hv-cinder-85221 Sep 09 21:43:18.835008 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-0d720cb9-5b00-4069-be74-744848361637 req-41094f68-22a8-41f5-b552-2f5d748c3f41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032914 Sep 09 21:43:18.839290 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 551/1122] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:43:18.853819 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4a7230c2-4ee7-41e1-aa66-5a9b6ce1b7a3 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Going to try to terminate instance {{(pid=120465) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:43:18.948576 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4a7230c2-4ee7-41e1-aa66-5a9b6ce1b7a3 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "DELETE /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 204 len: 0 microversion: 2.1 time: 0.148988 Sep 09 21:43:18.949407 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 572/1123] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:43:18 2022] DELETE /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:43:18.958461 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-94a6152d-2083-451b-8d72-3526a7b26d1e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:18.960042 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-94a6152d-2083-451b-8d72-3526a7b26d1e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:18.968607 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-94a6152d-2083-451b-8d72-3526a7b26d1e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:18.969324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-94a6152d-2083-451b-8d72-3526a7b26d1e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:18.969979 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-94a6152d-2083-451b-8d72-3526a7b26d1e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:18.970948 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-94a6152d-2083-451b-8d72-3526a7b26d1e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:18.971623 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-94a6152d-2083-451b-8d72-3526a7b26d1e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:18.972249 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-94a6152d-2083-451b-8d72-3526a7b26d1e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:19.141324 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.policy [None req-94a6152d-2083-451b-8d72-3526a7b26d1e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120466) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:43:19.154717 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-94a6152d-2083-451b-8d72-3526a7b26d1e tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1576 microversion: 2.1 time: 0.200428 Sep 09 21:43:19.163600 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 552/1124] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:43:18 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:43:20.179988 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-8710f30d-ab90-4ac1-b056-bff1b278b54a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:20.180692 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-8710f30d-ab90-4ac1-b056-bff1b278b54a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:20.187590 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8710f30d-ab90-4ac1-b056-bff1b278b54a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:20.188130 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8710f30d-ab90-4ac1-b056-bff1b278b54a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:20.188586 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8710f30d-ab90-4ac1-b056-bff1b278b54a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:20.189312 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8710f30d-ab90-4ac1-b056-bff1b278b54a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:20.189791 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8710f30d-ab90-4ac1-b056-bff1b278b54a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:20.190227 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-8710f30d-ab90-4ac1-b056-bff1b278b54a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:20.274369 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.policy [None req-8710f30d-ab90-4ac1-b056-bff1b278b54a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a25c97f4748119366c35dd4688765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a36910972a4d87b508b918af36bbd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120465) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:43:20.282109 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-8710f30d-ab90-4ac1-b056-bff1b278b54a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 200 len: 1390 microversion: 2.1 time: 0.106907 Sep 09 21:43:20.282676 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 573/1125] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:43:20 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 1390 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:43:20.428545 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [req-104e4f90-700e-4c1a-8488-fd518a33bc66 req-45fe90fa-0da7-4568-b21b-46460b3347b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394a5227-01ae-4083-957d-1fe7d267a71f", "name": "network-vif-deleted", "tag": "4fa80268-fdbb-44c1-8d74-a9162a890e21"}]} {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:43:20.437881 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-104e4f90-700e-4c1a-8488-fd518a33bc66 req-45fe90fa-0da7-4568-b21b-46460b3347b2 service nova] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:20.438329 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-104e4f90-700e-4c1a-8488-fd518a33bc66 req-45fe90fa-0da7-4568-b21b-46460b3347b2 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:20.438754 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [req-104e4f90-700e-4c1a-8488-fd518a33bc66 req-45fe90fa-0da7-4568-b21b-46460b3347b2 service nova] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:20.449643 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.compute.server_external_events [req-104e4f90-700e-4c1a-8488-fd518a33bc66 req-45fe90fa-0da7-4568-b21b-46460b3347b2 service nova] Creating event network-vif-deleted:4fa80268-fdbb-44c1-8d74-a9162a890e21 for instance 394a5227-01ae-4083-957d-1fe7d267a71f on hv-cinder-85221 Sep 09 21:43:20.454497 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [req-104e4f90-700e-4c1a-8488-fd518a33bc66 req-45fe90fa-0da7-4568-b21b-46460b3347b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151726 Sep 09 21:43:20.455091 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 553/1126] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Sep 9 21:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:43:21.309109 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:21.309695 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: 394a5227-01ae-4083-957d-1fe7d267a71f] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:21.315891 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:21.316373 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:21.316804 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:21.317488 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:21.317938 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:21.318361 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:21.331240 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] HTTP exception thrown: Instance 394a5227-01ae-4083-957d-1fe7d267a71f could not be found. Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Request method failure captured: Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f HTTP/1.1 Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7FfON-ccvRMDYJKxIU0eVME27-XOMI6ONjxEjjKkLVy7f6bJSr9ENB_6_GufjBGoUXDT3pEC7RoAjcdzkpWaB5PUKxykiLHOSb7qm_mFklL1kXYY8edWwYS0rcG4b5L2VVQTAJiIeuL4E0Mt0dcXyIQ32m-uNV9BBI7YR-ha6vO8UY Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: b9a36910972a4d87b508b918af36bbd5 Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:43:21.332872 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9a36910972a4d87b508b918af36bbd5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9a36910972a4d87b508b918af36bbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9a36910972a4d87b508b918af36bbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9a36910972a4d87b508b918af36bbd5"}]}] Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: b9a36910972a4d87b508b918af36bbd5 Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-TestVolumeBootPattern-23828200-project Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 691a25c97f4748119366c35dd4688765 Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-TestVolumeBootPattern-23828200-project Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance 394a5227-01ae-4083-957d-1fe7d267a71f could not be found. Sep 09 21:43:21.334748 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': '394a5227-01ae-4083-957d-1fe7d267a71f'} Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394a5227-01ae-4083-957d-1fe7d267a71f could not be found. Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:43:21.335782 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394a5227-01ae-4083-957d-1fe7d267a71f could not be found. Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394a5227-01ae-4083-957d-1fe7d267a71f could not be found. Sep 09 21:43:21.337400 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:21.338920 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Returning 404 to user: Instance 394a5227-01ae-4083-957d-1fe7d267a71f could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:43:21.338920 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-c6a45af9-b053-4e31-b021-6e34735e43ef tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f" status: 404 len: 111 microversion: 2.1 time: 0.030118 Sep 09 21:43:21.338920 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 574/1127] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:43:21 2022] GET /compute/v2.1/servers/394a5227-01ae-4083-957d-1fe7d267a71f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:43:22.017946 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:22.018510 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.compute.api [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120466) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:22.026627 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:22.027121 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:22.027588 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:22.028297 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:22.028760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:22.029189 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG oslo_concurrency.lockutils [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:22.043041 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.wsgi [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] HTTP exception thrown: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Request method failure captured: Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: request: DELETE /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b HTTP/1.1 Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept: application/json Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Accept-Encoding: identity Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Connection: close Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Length: 0 Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Content-Type: application/json Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Host: 10.222.0.46 Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: Openstack-System-Scope: None Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: User-Agent: python-urllib3/1.26.12 Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Auth-Token: gAAAAABjG7FfON-ccvRMDYJKxIU0eVME27-XOMI6ONjxEjjKkLVy7f6bJSr9ENB_6_GufjBGoUXDT3pEC7RoAjcdzkpWaB5PUKxykiLHOSb7qm_mFklL1kXYY8edWwYS0rcG4b5L2VVQTAJiIeuL4E0Mt0dcXyIQ32m-uNV9BBI7YR-ha6vO8UY Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Id: None Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Domain-Name: None Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Identity-Status: Confirmed Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Is-Admin-Project: True Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Id: default Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Domain-Name: Default Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Id: b9a36910972a4d87b508b918af36bbd5 Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Project-Name: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Role: reader,member Sep 09 21:43:22.044760 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Roles: reader,member Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9a36910972a4d87b508b918af36bbd5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9a36910972a4d87b508b918af36bbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9a36910972a4d87b508b918af36bbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9a36910972a4d87b508b918af36bbd5"}]}] Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Id: b9a36910972a4d87b508b918af36bbd5 Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-Tenant-Name: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User: tempest-TestVolumeBootPattern-23828200-project Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Id: default Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Domain-Name: Default Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Id: 691a25c97f4748119366c35dd4688765 Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: X-User-Name: tempest-TestVolumeBootPattern-23828200-project Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: method: > Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: exception: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:43:22.046792 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: action_args: {'id': 'bc844a55-4e91-445f-8de9-c8ff4e9af66b'} Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:43:22.047834 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:43:22.049467 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: ERROR nova.api.openstack.wsgi Sep 09 21:43:22.051257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Returning 404 to user: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. {{(pid=120466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:43:22.051257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-ce5dfda4-213a-4071-abe4-dda983f4de7a tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 404 len: 111 microversion: 2.1 time: 0.032481 Sep 09 21:43:22.051257 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 554/1128] 10.222.0.46 () {58 vars in 1239 bytes} [Fri Sep 9 21:43:22 2022] DELETE /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:43:22.055364 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '>' {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:22.056048 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.compute.api [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] [instance: bc844a55-4e91-445f-8de9-c8ff4e9af66b] Fetching instance by UUID {{(pid=120465) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:43:22.062051 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:22.062532 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:22.062964 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:22.063680 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Acquiring lock "b917e871-a448-4561-a39a-585fcf48a3c9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:43:22.064140 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:43:22.064567 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG oslo_concurrency.lockutils [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Lock "b917e871-a448-4561-a39a-585fcf48a3c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:43:22.078120 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.wsgi [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] HTTP exception thrown: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Request method failure captured: Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: request: GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b HTTP/1.1 Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept: application/json Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Accept-Encoding: identity Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Connection: close Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Length: 0 Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Content-Type: application/json Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Host: 10.222.0.46 Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: Openstack-System-Scope: None Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: User-Agent: python-urllib3/1.26.12 Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Auth-Token: gAAAAABjG7FfON-ccvRMDYJKxIU0eVME27-XOMI6ONjxEjjKkLVy7f6bJSr9ENB_6_GufjBGoUXDT3pEC7RoAjcdzkpWaB5PUKxykiLHOSb7qm_mFklL1kXYY8edWwYS0rcG4b5L2VVQTAJiIeuL4E0Mt0dcXyIQ32m-uNV9BBI7YR-ha6vO8UY Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Id: None Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Domain-Name: None Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Identity-Status: Confirmed Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Is-Admin-Project: True Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Id: default Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Domain-Name: Default Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Id: b9a36910972a4d87b508b918af36bbd5 Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Project-Name: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Role: reader,member Sep 09 21:43:22.079699 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Roles: reader,member Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b9a36910972a4d87b508b918af36bbd5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9a36910972a4d87b508b918af36bbd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b9a36910972a4d87b508b918af36bbd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b9a36910972a4d87b508b918af36bbd5"}]}] Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Id: b9a36910972a4d87b508b918af36bbd5 Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-Tenant-Name: tempest-TestVolumeBootPattern-23828200 Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User: tempest-TestVolumeBootPattern-23828200-project Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Id: default Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Domain-Name: Default Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Id: 691a25c97f4748119366c35dd4688765 Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: X-User-Name: tempest-TestVolumeBootPattern-23828200-project Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: method: > Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: exception: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:43:22.081410 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: action_args: {'id': 'bc844a55-4e91-445f-8de9-c8ff4e9af66b'} Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: {{(pid=120465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:43:22.082305 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. Sep 09 21:43:22.083958 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: ERROR nova.api.openstack.wsgi Sep 09 21:43:22.086155 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: DEBUG nova.api.openstack.wsgi [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Returning 404 to user: Instance bc844a55-4e91-445f-8de9-c8ff4e9af66b could not be found. {{(pid=120465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:43:22.086155 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: INFO nova.api.openstack.requestlog [None req-4f6d2d40-5e6b-4db1-b70a-01becda11fb4 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b" status: 404 len: 111 microversion: 2.1 time: 0.029888 Sep 09 21:43:22.086155 dv-cinder-852210-15-iscsi devstack@n-api.service[120465]: [pid: 120465|app: 0|req: 575/1129] 10.222.0.46 () {58 vars in 1236 bytes} [Fri Sep 9 21:43:22 2022] GET /compute/v2.1/servers/bc844a55-4e91-445f-8de9-c8ff4e9af66b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:43:23.400380 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: DEBUG nova.api.openstack.wsgi [None req-3f207289-b6ff-46fe-88fe-187730dc8f36 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] Calling method '.version_select at 0x7f0812dc3e50>' {{(pid=120466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:43:23.427924 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: INFO nova.api.openstack.requestlog [None req-3f207289-b6ff-46fe-88fe-187730dc8f36 tempest-TestVolumeBootPattern-23828200 tempest-TestVolumeBootPattern-23828200-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-225754611" status: 202 len: 0 microversion: 2.1 time: 0.031044 Sep 09 21:43:23.432736 dv-cinder-852210-15-iscsi devstack@n-api.service[120466]: [pid: 120466|app: 0|req: 555/1130] 10.222.0.46 () {58 vars in 1260 bytes} [Fri Sep 9 21:43:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-225754611 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)